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Preface 


This document contains the proceedings of the Workshop on Advanced Group Support 
Systems and Facilities, held at NASA Langley Research Center, Hampton, Virginia, July 
19-20, 1999. The workshop was jointly sponsored by the University of Virginia’s Center 
for Advanced Computational Technology and NASA. Workshop attendees came from 
NASA, other government agencies, industry and universities. The objectives of the 
workshop were to assess the status and effectiveness of different advanced training 
technologies and learning environments. 

Certain materials and products are identified in this publication in order to specify 
adequately the materials and products that were investigated in the research effort. In no 
case does such identification imply recommendation or endorsement of products by NASA, 
nor does it imply that the materials and products are the only ones or the best ones available 
for this purpose. In many cases equivalent materials and products are available and would 
probably produce equivalent results. 
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Future Trends - Collaborative Distributed Engineering Environments 


Rapidly developing technologies and changing economic realities promise to have a profound impact 
on engineering environments and practice, as well as on engineering organizations, over the next few 
years. The forces driving a paradigm change in engineering practice are described subsequently. 
Among the influences taking shape today are the convergence of computing, communication, and 
information technologies; advances in modeling, simulation and manufacturing technologies, and in 
knowledge-based engineering (the incorporation of artificial intelligence and expert systems into 
product development processes). 

As a result of technological advances, globalization of markets, and heightened competitive 
pressures, the early twenty-first century will witness dramatic changes in the way high-tech 
engineering systems are designed, produced, operated, maintained, and eventually, disposed of. 
Future environments will permit collaboration among teams in several engineering disciplines at 
widely distributed locations, and will enable them to rapidly apply novel technologies, create better 
products in less time, and better manage risks. The teams will be provided with groupware tools and 
facilities (which are the focus of this workshop) to significantly improve their ability to explore, 
generate, track, store and analyze alternative product development processes. 





Forces Driving a Paradigm Change in Engineering Practice 

There are four categories of forces that are driving a paradigm change in engineering practice (Fig. 2): 

• Development in organizations and workplaces. In the 1980’s the focus of engineering 
organizations was on quality through reduction of defects and use of TQM models. In the 1990’s 
the focus shifted to reengineering and streamlining the processes through the use of virtual 
product development (VPD) and enterprise resource planning (ERP) systems. As we move from 
the industrial to the knowledge era, engineering organizations will make radical changes in the 
workplaces, use electronic performance support systems (EPSS), and create virtual organizations 
with the overall goal being to achieve very high performance workplaces. Workplaces will be 
transformed from stationary offices centered around desktop computers and workstations into 
intelligent networked environments that enable diverse geographically dispersed teams to 
collaborate in real time. 

• Economic pressures. To remain competitive, engineering organizations will move from mass 
production to mass customization. In addition, the rapid technology changes will continuously 
change the knowledge requirements of workers (continuous need for learning). 

• Growing interdependence among technology, workplace and learning. Technology will 

significantly impact workers by providing just-in-time information and skills, and will change the 
workplace by making learning and work synonymous. It will help in transforming engineering 
organizations into learning organizations. 

• Resistance to change. Because of the increasing number of older learners and the need for just-in- 
time training, flexible delivery systems have to be used. Also, engineering organizations need to 
have realistic expectations from, and provide incentives for, using new technologies. 
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Groupware 


The term groupware refers to both the technology for managing relationships and information and the 
software products that support groups of people engaged in a common task or goal. It includes 
various kinds of computer-based systems that provide an interface to an environment shared by a 
group, and supports that group in carrying out common tasks. 

Three major classes of groupware can be identified; namely, communication facilities; collaborative 
facilities; and decision making systems. Communication facilities include message systems (e.g., 
electronic mail, bulletin boards and newgroups); conferencing systems (e.g., desktop and real-time 
data conferencing facilities); and middleware - software that connects separate applications, serves as 
a glue between these applications, and allows users to work with any server (e.g., suite of services for 
distributed computing environment (DCE), and common object request broker architecture 
(CORBA). Collaborative facilities include coordination systems, groupware development tools and 
tele-immersive facilities. Decision making systems are described subsequently. 





Computer-based systems which 

- provide an interface to an environment shared by a group 

- supports the group in carrying out a common task 


0 Managing relationships and information / knowledge 


Figure 3 



Decision Support Systems 


Decision support systems are generally concerned with improving the effectiveness and efficiency of 
knowledge management activities that occur in the course of decision making. The following 
objectives of group decision support systems (GDSS) can be identified: supplement the decision 
making team by helping to answer what-if questions; allow better intelligence, design or choice; 
facilitate problem solving; provide aid for non-structured decisions; and managing information and 
knowledge. Two types of information/knowledge are used in GDSS: primary and secondary. The 
primary information/knowledge types include: descriptive (information or data) - know what; 
procedural - know how; characterizes how to do things; reasoning - identifying particular 
circumstances under which certain conclusions are valid. The secondary information/knowledge 
types include: linguistic, which enables the user to understand incoming messages; assimilative, 
which is a filter to keep out low quality knowledge and prevent knowledge overloads; and 
presentation, for constructing outgoing messages and decisions. 
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Evolution of Decision Support Systems (DSS) 

Decision support systems can be traced to the data processing systems of the 1950s and 1960s, 
including both the automatic data processing (ADP) and electronic data processing ( ED P) systems. 
These systems evolved into the 'management information systems (MIS) of the 1970s and 1980s, 
which had very limited decision support facilities. In the late 1980s, decision support systems (DSS) 
were developed to automate the various knowledge management tasks, and had the following 
characteristics: they could interact directly with a decision maker or decision making participant; they 
often held descriptive and other types of information/knowledge; they had the ability to acquire and 
maintain each of the information/knowledge types listed in Fig. 5; and, they could derive new 
knowledge from existing ones for recognizing and/or solving problems. The 1990s witnessed a 
growth in DSS. Some of the current DSS incorporate high capacity communication and networking 
technologies, expert systems, and brainstorming facilities. The trend is towards adding advanced user 
interfaces, including natural language and multi-lingual communication; soft computing (fuzzy logic, 
neural networks and genetic algorithms); and intelligent agents. Decision support systems play an 
important role in many business computing and enterprise resource planning (ERP) systems 
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Some Categories of Business Computing Systems 


Task support systems (TSS) form a broad class of business computing systems for supporting 
management, personnel, research terms, consumers and suppliers of a business. Multi -participant 
decision support systems (MDSS) constitute an important category of TSS. It includes both group 
and organization decision support systems (GDSS and ODSS) The distinction is based on the 
functional and authority differences in roles between the participants. Four categories of MDSS can 
be generated by varying displacement in time and place. 

















Enterprise Resource Planning (ERP) 


Enterprise Resource Planning (ERP) systems are integrated software systems that enable the planning 
of resources at and among the strategic, tactical, and operational levels of an enterprise. They provide 
transaction management to enable accurate and timely execution of decision support systems to plan 
the design and manufacturing, human resources, finances, and marketing and sales across an 
enterprise. 



i| Integrated software systems which enable 
the planning of resources at and among the 
strategic, tactical and operational levels of 
the enterprise 


® A confluence of simulation, transaction 

management and decision support systems 



Figure 7 
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Evolution of ERP 


ERP systems evolved from several domains: manufacturing, finance, human resources, and 
marketing/sales. The development of ERP dates back to the material requirement planning (MRP) 
systems of the 1960’s and 1970’s. Current ERPs go beyond manufacturing and financial functions. 
They include multi-plant and supply chain views. They support different production environments 
(e.g., job shop, intermittent, repetitive, continuous, mixed mode), and include simulation capabilities 
at various levels of an enterprise. Future ERPs will include facilities for supply chain integration, 
business development and electronic commerce. 
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Group Support System Vendors 

The goal of current group support systems (GSS) is to enhance and facilitate productivity 
improvements in daily problem solving and idea exchange situations. The two major components of 
GSS are shared objects and group dynamics. Most of the GSS in use today have one or the other. A 
partial list of the GSS vendors is shown in Fig. 9. The typical setup in some of the GSS is a room for 
teleconferencing or meeting with projection screens and facilities for everyone to view the 
contributions of other participants. 







Government Activities Using Requiring GSS 


The potential benefits for product development and scientific research have led many organizations to 
initiate programs to design collaborative distributed virtual environments Among the government 
activities that either use, require, or can benefit from GSS, are the knowledge and distributed 
intelligence (KDI), and the Advanced Computational Infrastructure and Research of the National 
Science Foundation; the Intelligent Collaboration and Visualization Program (IC&V) of the Defense 
Advanced Research Projects Agency; the Digital Library Initiative (DLI) which is in its second 
phase; the Manufacturing Collaboratory of the National Institute of Standards and Technology; and 
the Intelligent Synthesis Environment (ISE) of NASA, ISE is described subsequently. 
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Intelligent Synthesis Environment 


The Intelligent Synthesis Environment (ISE) Project of NASA attempts to meet the needs of future 
systems and missions. The ultimate goal of ISE is the seamless integration of teams, processes and 
disciplines, thereby enabling an end-to-end simulation of the product life cycle and mission scenarios 
before the mission begins. ISE will link design teams, manufacturers, scientists, suppliers and 
consultants in the creation and operation of an aerospace system and in synthesizing its missions. The 
teams will use robust systems engineering approaches, and will be provided with tools and facilities 
to significantly improve their ability to explore, generate, track, store and analyze different mission 
scenarios and alternative product development processes. These may include group support systems. 
ISE has five major components: rapid synthesis and simulation tools; cost and risk management 
technology; life cycle integration and validation; collaborative engineering environment; and cultural 
change - training and education. 



Figure 1 1 
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Distributed Learning Environment (DLE) 


Two activities are performed as part of the ISE program. The first is the development of distributed 
learning environment and the second is simulation of diverse team structures and processes. The 
distributed learning environments will incorporate state-of-the-art multimedia, immersive facilities 
and multi-sensory interfaces, and will be tailored to each individual learner’s needs. The environment 
enables learning anywhere and at any time. The use of GSS can enhance the effectiveness of the 
distributed learning environment. 

Dynamic process improvement can be performed by: a) simulation of the procedures, processes and 
coordination/integration mechanisms involved in the distributed interactions between instructors and 
learners as well as the information flow during these interactions; and b) development of metrics for 
assessing the effectiveness of learning (Fig. 12). The effective deployment of DLE can result in a 
skilled workforce able to sustain technological growth. 



Figure 12 
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GroupSystems: Software for Team Productivity 

Robert O. Briggs 

Ventana Corporation - University of Arizona 
1413 East Fort Lowell Road. 

Tucson, A Z 85719 

Dr. Robert 0. Briggs is Director of Product Management at 
GroupSystems.com, a spin-off company of the University of Arizona. He is 
also Research Coordinator for the Center for the Management of Information 
at the University of Arizona. As a researcher he investigates the theoretical 
foundations of collaborative effort. He has published more than fifty 
scholarly works on group productivity, creativity, satisfaction, learning, and 
has published a landmark model of technology transition to explain the 
causes of self-sustaining and growing communities of users for technology 
transition. He conducts laboratory field studies to develop and test new 
collaborative technologies, new concepts of operation, and new work 
environments that foster collaboration. As Director of Product Management 
at GroupSystems.com he plots the future development trajectory of 
collaborative software products. 


GroupSystems* : 

Software for Team Productivity 



G roupSystems' 


Robert O. Briggs, Ph.D. 

Ventana Corporation - University of Arizona 

1430 E. Ft. Lowell Rd. Tucson, A2 85719 USA 
www.ventana.com (520) 322-7179 


19 




Briefing Topics 


This briefing covers three key topics. First, it explains GroupSystems 
software and positions it within the groupware domain. Next it presents the 
results of extensive field experience with GroupSystems in government, 
military and private sector deployments. Finally, it offers a glimpse of the 
future directions of group support systems in general. 


Briefing Topics 

•What is GroupSystems? 
• GSS results 
•The future of GSS 
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What is GroupSystems? 

GroupSystems was the world’s first Group Support Systems (GSS), 
developed at the University of Arizona, and commercialized by 
GroupSystems.com, a spin-off from the University. It is by far the most 
sophisticated GSS with respect to the variety and power of group dynamics it 
can create and sustain. 

You might think of GroupSystems as a virtual workplace, where 
geographically separated team members can meet and work together in cyber 
space. But its collaborative capabilities are far more. 

You might think of GroupSystems as a collection of shared objects, 
things that everybody on the team can work on. But this framing, too, would 
overlook its power. To understand it better, consider the triangle model on 
the following slide. 


What is GroupSystems 

* The first Group Support 
System (GSS) 

* A virtual workspace 

* A collection of shared objects 
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The Collaborative Capability Layers 


Collaborative technology can offer functionality in three layers: 
information sharing, group dynamics, and goal attainment. Technology in the 
information sharing layer allows people to exchange information. There are 
many products in the information sharing layer. Examples are 
teleconferencing, application sharing, chat and e-mail. Technology in the 
group dynamics layer allows a group to predictably create and sustain useful 
patterns of interaction. For example, sometimes a group needs to diverge from 
customary thinking patterns. Other times it might need to converge on key 
issues, or to deeply explore a tightly focused set of issues in great depth and 
detail. GroupSy stems offers a suite of tools that may be used by a team to 
create the dynamics they need to support their work. Technology in the goal 
attainment layer can help a group step through a carefully crafted series of 
activities that will let them achieve their goal. For example, a group might 
want to create a strategic plan, or conduct a risk assessment. Each step in the 
process is made up of dynamics selected from the layer below. The power of 
GroupSystems lies in its ability to support and sustain a group process through 
all the steps as the group works toward a goal. 


Collaborative Capability Layers 


. Understand the Problem 
Develop alternatives 
. Choose an Alternative 
Goal \Plan 
/ Attainment\ Act 


Group Dynamics 

Diverge - Converge 
'Organize - Deepen -- Agree' 


Information Sharing 
Talk -- Send Messages - 
Share Applications - Exchange Documents 
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Another Way to Think of GroupSystems 


GroupSystems is a set of tools for focusing and structuring efforts of a 
group working jointly toward a goal. It is one of the few technologies that 
offers capabilities in all three layers. 


GroupSystems 

A set of tools for 
structuring and 
focusing the efforts of 
a group working 
jointly towards a goal. 
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When Do You Need GroupSystems? 

GroupSystems is not a panacea. It is massively useful under some 
circumstances, and not as useful under others. GroupSystems is most 
effective for a task where no one person has all the information, inspiration, 
expertise, or resources to achieve the task alone. If there is a single expert 
you can go to for an answer, do it. GroupSystems won’t help. If you need to 
get the group to buy into an answer you already have, don’t use 
GroupSystems. It won’t convince people to see things your way. On the other 
hand, if you want to get honest feedback on a solution you are considering, 
GroupSystems is an outstanding way to collect it quickly, in well-organized 
detail. If you don’t even understand the problem, much less have a solution, 
GroupSystems is for you. Under these circumstances teams find that by using 
GroupSystems they can complete in a day work that used to take more than a 
week. 


GroupSystems 

• Good when no one person 
has all the 

-Information 

-Inspiration 

-Expertise 

-Resources 

to solve the problem alone. 
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GroupSystems Outputs 


You know what you get out of spreadsheet software - a spreadsheet - 
mathematical model. You know what you get out of a word processor - a 
typed document. What do you get out of GroupSystems? There are two kinds 
of outputs from GroupSystems: collaborative obj ects and group dynamics. 

Collaborative objects are tangible - you can see them on the screen. 
They are very easy to demonstrate and understand. Group dynamics are 
patterns of interaction among group members. Group dynamics are also 
tangible, in that you can observe them and measure them. They are the more 
important kind of output from GroupSystems, but I cannot show them to you 
on a slide or on a computer screen. I can’t demonstrate them on the podium, 
because, of course, they only emerge when teams are working together 
toward a goal. Nonetheless, I can tell you about them, and you can see them 
foryourself when you use the software. First, however, let’s look a little more 
closely at the collaborative objects. 


Two Kinds of Outputs 
From GroupSystems 

• Collaborative Objects 
-Tangible 

-Easy to understand 

• Group Dynamics 

- Just as tangible 

- Probably more important 
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Collaborative Objects 


A collaborative object is a digital thing that many people may contribute 
to simultaneously. I don’t mean that one person can look at it while another 
person works on it. I mean that every team member has his/her own cursor in 
the object at the same time. Each person works on a different computer, but 
they all see the same object, and any contribution from one person is 
immediately available to the other people on their own screens. 

GroupSystems offers a variety of shared objects, including lists, texts, 
graphics, outlines, and several others. The next two slides show examples. 


Collaborative Objects 

• Shared Lists 

• Shared Texts 

• Shared Graphics 

• Shared Outlines 

• Etc. 

• All participants contribute 
simultaneously 
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Topic Commenter 


This is the GroupSystems Topic Commenter. It offers the users a stack of 
electronic cards. The participants may add cards to the stack. They may also 
click open any card and write on it. Any cards added by one participant appear 
on the screens of the other participants. Any comments by one person appear 
on the screens of all the other participants. That is why we call this a 
collaborative obj ect. 


% SiwSytfewr Technology Irtutt fToptc Comtaentevl] 
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Group Outliner 


Here is another collaborative object from the GroupSystems toolkit. This 
is the Group Outliner. All members of the team may contribute headings and 
subheadings to the outline. They may work together to rearrange the outline 
until they have it as they like it. 

Every heading on the outline links to a shared text window where all 
team members may contribute. All team members may view the same text, or 
each may work on a different part of the outline. 

Topic Commenter and Group Outliner are examples of the collaborative 
objects from the GroupSystems toolkit. 


u v GroupSystems Collaborative Molecules Architecture - (Collaborative Molecules Descriptions [Group Outliner)] 





1.2. 4.1 Participants 

t 1.2. 4.1 .1 unique id 
1.2.4 1 2 name labels 


-1. 2.4.1 .2.1 I 
— 1.2 4.1 .2.2 I 
-1.2 4.1 .2.3 1 



-1.2. 4.1 .3 vitae 
-1.2. 4. 1.3.1 picture 
-1.2. 4.1 .3.2 email address 
— 1 .2 4.1 3 3 web home page 
-1.2. 4.1 .3.4 active phone number 
*- 1 .2.4.1 .3.5 other information 
-1.2. 4. 1.4 password 
1-1. 2. 4 1 5 superuser (boolean) 

-1.2.5 Pentopticon view/management of environment (all atoms and molecules) 

t 1.2. 5.1 Garbage Collection 

1. 2.5.2 creation of root atoms 

1.2. 5. 3 atom and mo!ecule"manager" (analog to "file manager") 

-1.3 Template management Section 

t l 3.1 Create links to collaborative Molecules 
1 3.2 Create Templates 
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Key Advantages of Collaborative Objects 

There are several advantages to working with collaborative objects 
instead of stand-alone computer tools and standard meetings. First, nobody 
must wait for a turn to speak. People contribute their ideas as soon as they 
think of them, so they don’t forget them while waiting for the floor. Further, 
they don’t miss what others are saying because they are trying to remember 
what they want to say themselves. If they stop to think about something, they 
still don’t miss what others are saying because it will all be there on the 
computer. 

Ever been in a meeting with that one person who can suck the oxygen 
out of the room. You know, the person who gets half the airtime no matter 
what is being discussed. That can’t happen with GroupSystems. No matter 
how much anybody says, the rest of the people go right on contributing. 
Studies show that people using GroupSystems participate far more equally 
and fully, and that each additional participant does, indeed, add to the 
intellectual bandwidth of the effort. More people, more view points, more 
information, more solutions, better results. When the work is done, the 
system has an electronic transcript of the results that can be searched and 
used later. No good ideas are permanently forgotten. 


Key Advantages of Collaborative Objects 

• No waiting for a turn to speak 

- No forgetting what you want to say 

- No missing what others say 

• Nobody can dominate the floor 

- Full participation 

- Complete exploration of viewpoints 

• Electronic transcripts 

• Many minds make work light 
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The Important Output: Group Dynamics 


Collaborative objects like Topic Commenter and Group Outliner are 
useful and interesting, but the true power of GroupSystems lies not so much in 
the object itself, but in what the object can do to group dynamics. Each tool in 
the GroupSystems suite can be used to create predictable patterns of group 
interaction on demand. Some of the basic patterns are: Diverge, Converge, 
Organize, Deepen, and Agree. For example, the GroupSystems Electronic 
Brainstorming tool encourages a group to diverge from comfortable thinking 
patterns to go farther and farther afield in search of new ideas. The Categorizer 
tool, on the other hand, encourages a group to converge quickly on just the key 
issues that should get their attention. The Topic Commenter encourages depth 
and detail. The polling tools can reveal patterns of agreement, or highlight 
patterns of disagreement. 

GroupSystems supports the basic group dynamics listed below and 
allows the team to select variations and nuances to those dynamics to suit their 
purposes. 


Group Dynamics 
with GroupSystems 

• Create Patterns of Group 
Interaction 

-Diverge from customary thinking 
-Converge on key issues 
-Organize thoughts 
-Deepen understanding of detail 
-Agree on meanings and actions 
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GroupSystems Modes of Collaboration 


Teams use GroupSystems in a variety of modes. Sometimes they use it 
as they work face-to-face, wrestling with knotty issues or working together to 
create detailed plans and documents. 

Other times it isn’t possible or necessary for a group to gather face to 
face. In those cases they often use GroupSystems over the Web supported by a 
conference call or a video teleconference. 

It is not unusual for teams to use GroupSystems to work together 
asynchronously - different place, different time. Each team member 
contributes when they can - day or night, regardless of time zone. 


GroupSystems Modes of 
Collaboration 

• Face-to-Face 

• Distributed 

• Asynchronous 
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The IBM Owego Case 


Earlier I promised to tell you about some of the results obtained by 
people using GroupSystems in the field. One of the earliest high-profile 
successes happened at IBM’s plant in Owego, New York. Teams there met 
regularly to try to solve production quality problems on the factory floor. IBM 
had extensive historical records of how much time these teams spent to solve 
their problems. 

We worked with IBM’s quality teams to create a repeatable 
GroupSystems process for solving quality problems. Over the first year IBM 
tracked the work of thirty teams who used GroupSystems. These teams had an 
average labor saving of 50%, and cut the number of calendar days in their 
projects by an average of 90%. 

The results were so dramatic that IBM suspected it might be a fluke, so 
they conducted a study at six more sites the following year. Results at those six 
sites slightly exceeded the first year’s benefits. 


GroupSystems Face-To-Face 

TQM at IBM 
50% Labor Savings 
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GroupSystems in Government 


The gentleman third from the left in this picture was the President of the 
newly liberated countiy of Slovenia when this photograph was taken. Slovenia 
managed to talk its way out of Yugoslavia and out of the Bosnian conflict 
without firing a shot. When they had gained their independence, the president 
and cabinet used GroupSystems to hammer out their monetary policies and for 
other crucial issues. 

Closer to home, when Vice President A1 Gore initiated his National 
Partnership for Reinventing Government, he invited eight groups to come to 
Washington for a major kick-off event. He asked each group to produce a 
White Paper on some important aspect of government. One of the eight 
groups, a team of forty people, elected to use GroupSystems during the three- 
day kickoff event. At the end of the three days, that group had produced the 
first draft of their White Paper. The other seven groups had produced plans to 
reconvene at a later time to finish planning how they would produce theirs. 




GroupSystems in the Military 


All four branches of the military and the Department of Defense use 
GroupSystems for a variety of mission critical tasks. This is the U.S. Air Force 
Innovation Center at the Pentagon. High-ranking officers meet here to work 
out new, more effective ways to maintain the readiness and capabilities of the 
Air Force. 
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USS Coronado Civil Military Operations Center 


This is the Civil Military Operations Center aboard the U.S.S. Coronado, 
the Command Ship of the U.S. Navy’s Commander, Third Fleet. It was the 
first GroupSystems collaborative decision space afloat. It offers a host of 
collaborative capabilities including secure and open phone and radio channels, 
video teleconferencing, secret and open Internet, and a variety of multimedia 
display equipment. It was designed to support teams who must respond 
quickly to a crisis as it unfolds. 
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COMTHIRDFLT - J5 PLANS 


Aboard the U.S.S. Coronado, the J5 Plans Group was tasked to produce 
possible courses of action for the Joint Task Force Commander any time the 
situation required it. J5 had a good process that let them provide 
recommendations to the Admiral within ninety minutes. 

They decided to try GroupSystems. We worked with them to create a 
repeatable GroupSystems collaborative Course-of-Action development 
process. The new process took only thirty minutes. In that thirty minutes the 
officers were able to consider many times more possible courses of action, and 
were able to develop the courses of action they recommended to the Admiral 
in far more depth and detail. 


J5 Plans 

• Course of Action Development 
• Reduced from 90 to 30 min. 

• 7 X times more breadth 

• 4 X more depth & detail 
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COMTHIRDFLT - J2 Intelligence 


COMTHIRDFLT’s J2 Intelligence Department had cryptologists 
scattered around the ship in small spaces across three decks. The cryptologists 
would scan the environment for intelligence information, which they would 
enter into their paper logbooks. The intelligence analysts would circulate 
among the cryptologists, read the logbooks, and make entries in their own 
paper logbooks recording their interpretations and analyses. The senior watch 
officer would circulate among the analysts, synthesize a situational awareness, 
and brief the Admiral. This cycle took about thirty minutes. 

We worked with J2 to create a repeatable GroupSy stems intelligence 
analysis process. The cryptologists entered their findings into GroupSystems. 
No matter where they were on the ship, the analysts could see the entries 
immediately. They would begin their analysis in GroupSystems. The senior 
watch officer could immediately see the analyses and request clarifications. 
The Admiral could watch all this unfold from his own terminal. 
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Situational Awareness Cycle 


By using GroupSystems the J2 Situational Awareness Cycle was cut 
from thirty minutes to under a minute. When bullets are about to fly, that extra 
twenty-nine minutes makes a difference. 

Other units on the ship began to keep their own logbooks in 
GroupSystems, including the Land Forces Commander, the Battle Watch 
Captain, the Air Forces Commander, and the Fleet Fires Cell. 


J2 Intelligence 
Situation awareness cycle 
cut from 30 to under 1 minute 


X 
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Multi-Point Distributed Interactions 


Having tested GroupSystems aboard one ship, we extended the concept 
to multiple ships. This diagram shows the participants that used GroupSystems 
to resolve emergencies in simulated disaster relief exercises. 
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GroupSystems at School 


GroupSystems is the foundation of a new pedagogy now finding its way 
into educational institutions across the country. It is being used successfully 
in grammar schools, junior high and high schools, and in universities. The 
pedagogy, called “High Stakes Learning™, ” gets the learners involved in 
solving real problems in which they perceive a vested interest. The teacher 
carefully selects the problems so that the learners must learn what the teacher 
wants them to know in order to achieve the outcome they want. The teacher 
does not provide the answers. Rather, the teacher guides the learners through 
the problem-solving process as they dig out information and make sense of it. 
Results have been superb. Reading and writing scores have climbed. Problem 
solving and critical thinking skills skyrocket. The drop-out rate declines 
among high-risk learners. 

The pedagogy depends on GroupSystems for its success because 
GroupSystems provides the learners with the edge they need to get through 
real problems in the time available to them in class. 


D.C. Public Schools 

Curriculum Development 



D.C., Montana, Idaho, Arizona 
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Asynchronous Tasks with GroupSystems 


People use GroupSystems over the Web to support a vast array of 
collaborative tasks that they execute asynchronously. People participate as 
they can, regardless of time-of-day or time zone. Some of those tasks include: 
Product Management 
Requirements Definition 
Strategic planning 
Systems Engineering 
Risk Managem ent 
The list is nearly endless. 


GroupSystems 

Asynchronous 

• Product Management 

• Requirements Definition 

• Strategic Planning 

• Systems Engineering 

• Etc... 
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Critical Success Factors for GroupSystems 

Over the years we have learned some key points for creating a self- 
sustaining and growing community of users for GroupSystems. First and 
foremost, it is important that a team find a repeatable process that they do over 
and over with GroupSystems. They will find many other ways to use the tools 
overtime, but the repeatable process becomes the anchor that makes it possible 
for them to succeed in other tasks. Teams that only use GroupSystems for 
solving ad-hoc or non-routine problems tend not to be self sustaining. 

Second, keep the processes simple. GroupSystems offers a rich and 
powerful variety of possibilities. Sometimes people fall in love with the 
possibilities and create unnecessarily complex processes just because they can. 
The teams that find simple ways to use the power of GroupSystems tend to 
succeed. 

Finally, when you have established and tested a repeatable process, get it 
documented in a manual, and then formally train people to do it. That way the 
process can remain even as the people move on. 


GroupSystems Success 

• Find a repeatable collaborative process 

• Keep it simple 

• Document and train to it 





The Future of GroupSystems 


There are some exciting developments on the GroupSystems horizon. 
By 2000 GroupSystems will be available as a hosted service on the web. 
People will be able to purchase the service by the minute, by the day, month, 
or year. 

The collaborative objects now embedded in the proprietary 
GroupSystems environment will soon break free and be available as 
independent to embed in other people’s application environments. 

Finally, in the near future, there will be task-specific GroupSystems 
collaborative applications. 


GroupSystems Future 

* Hosted Web Service 

* Shared Objects Break Out 

* Shared Objects Embedded 

* Special Purpose GroupSystems 
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Alan Dennis 
Professor of MIS 
Terry College of Business 
University of Georgia 


adennis@uga.edu 


AIIS 

Terry 


47 




Focus of Presentation 


This presentation summarizes published research on the use of GSS using 
statistical meta-analysis techniques. As such, it discusses what scientific 
evidence can “prove,” as opposed to those things we believe to be true but 
cannot prove, although I will at times speculate on what I believe to be true. 

Meta-analysis requires the direct comparison of groups using GSS to groups not 
using GSS within the same study, so this presentation focuses only on studies 
that directly compare two or more groups. This has the unfortunate effect of 
producing a set of studies that is almost entirely laboratory experiments rather 
than field studies, but there were no significant differences between the lab 
studies and field studies. 

This set of studies includes both situations in which all group members worked 
in the same room at the same time, as well as those in which some (or all) 
participants worked in different places at different times. 


Focus 

• Published Research Studies Only 

• Studies Comparing the Performance of 
Groups With and Without GSS 

• Same-room and Any-time Any-place GSS 
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Performance Measures 


The focus of the analysis was to understand how GSS use affected four 
measures of group performance: 

• The quantity and quality of ideas generated. 

• The quality of decisions made. 

• The time taken to complete the task. 

• Participants’ satisfaction with the meeting process. 


Does GSS Improve Performance? 

• Idea Quantity and Quality 

• Decision Quality 

• Time Required 

• Participant Satisfaction with Process 

MIS?} 

Terry - 1 
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Overall Results 


The overall effect size for idea generation was .78, which was statistically 
significant. The effect size is measured in terms of the number of standard 
deviations by which GSS groups differed from non-GSS groups (a positive number 
indicates that GSS groups had higher values on this measure). In other words, 
groups using GSS produced much higher quality ideas and/or more ideas than 
groups without GSS. However, GSS use had no significant effect on the quality of 
decisions. Groups with and without GSS made similar quality decisions. Groups 
using GSS took significantly longer to perform tasks than groups without. There 
were no significant differences in participant satisfaction. 

More importantly, there was little consistency in results, suggesting that there 
are factors in the way in which the GSS is used that affect performance. 


Does GSS Improve Performance? 












Effects of Location and Time 

The key question then is, when does GSS improve performance? One factor that 
may affect performance is whether participants work together in the same room 
at the same time, or whether they work in different places and/or at different 
times. The next analysis was to split the data into two parts by location and time. 

Groups using GSS in the same room at the same time produced significantly 
more ideas and made significantly better decisions than groups working without 
GSS. However, they still took significantly longer. 

Groups working in different places/times produced significantly worse decisions 
than groups working without GSS. 


Effects of Location and Time 
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Effects of Group Size 


Small GSS groups produced significantly more/better ideas than small groups 
working without GSS, but took significantly longer and were significantly less 
satisfied. 

Large GSS groups produced significantly more/better ideas than large non-GSS 
groups and were significantly more satisfied. Interesting, there were no 
differences in time; large GSS groups do not take longer than non-GSS groups. 


Effects of Group Size 
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Effects of Process Fit 


Theory suggests that some GSS processes “fit” better some tasks than others. A 
process was considered a fit for the task if electronic discussion was used to 
generate ideas, and a combination of electronic and verbal discussion, and 
formal voting or rating of alternatives, were used for decision making tasks. 

In cases where the process fit the task, GSS groups produced significantly 
more/better ideas and better decisions than non-GSS groups. 

In cases where the process did not fit the task, GSS groups still produced 
significantly more/better ideas, but took significantly more time and were 
significantly less satisfied. 


Effects of “Process Fit” 





Fit means using electronic discussion for idea generation; and 
electronic and verbal discussion with electronic voting MIS' 

for decision making. 
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Effects of Facilitation 


The data were partitioned into situations with a low facilitation need (the group 
had used the same tool previously to perform similar tasks) or high facilitation 
need (the groups had either previously not used the tool or had not performed 
similar tasks). 

GSS groups produced significantly more/better ideas regardless of the situation 
or the presence/absence of a facilitator. The high facilitation need groups with a 
facilitator produced better decisions. GSS groups took longer than non-GSS 
groups with no facilitator, while high need groups without a facilitator were 
significantly less satisfied than non-GSS groups. 


Effects of Facilitation 



Need for facilitation is lower when a group has experience ]\/f TQr 

performing similar tasks with the same GSS processes 

and tools. 1 r>RRY 
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Summary 

In summary, GSS use improves the quantity and quality of ideas in almost all 
situations. 


When Does GSS Improve 
Performance? 

Idea quantity and quality is improved: 

• in almost all situations 


Mm 
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Summary 


GSS use improves decision quality when the group meets in the same room at 
the same time, when electronic voting and both electronic and verbal discussion 
is used, and when a facilitator assists groups who are new to the GSS tool being 
used or the task being performed. 


When Does GSS Improve 
Performance? 

Decision quality is improved: 

• when the group meets in the same room at 
the same time 

• when electronic voting is combined with 
both electronic and verbal discussion 

• when a facilitator assists groups working in 
unfamiliar situations. 
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Summary 


In general, over a wide variety of situations GSS use does not reduce the 
amount of time taken to complete the task. I found this surprising, because this 
is a benefit claimed by many users and vendors of GSS technology. 

There are at least two possibilities which may explain this anomaly. 


When Does GSS Improve 
Performance? 

Time is improved: 

• In general, never f ^ 
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Summary 


One possibility, which I believe to be true but cannot prove, lies in the duration 
of the tasks. Most studies (in these analyses) examined very short duration tasks 
(one-half day or less). It may be that GSS can reduce the amount of time to 
complete tasks, but only for “long” tasks that would normally exceed one-half 
day of work. In a study I did of 18 DoD task forces working on projects taking 
five days or longer to complete, GSS use reduced the time required by 75%. 
Thus, I believe GSS use reduces time for “large” tasks but not for “small” ones. 

A second possibility is that work expands to fill the time available. In a study I 
did of six project teams in a hospital that worked over a seven week time period, 
the GSS teams spent more time in meetings than did non-GSS teams, but 
worked harder and produced a better quality product. 


When Does GSS Improve 
Performance? 


Time needed is improved: 

• In general, never 


Possibilities: 

• Almost all studies examined short tasks 
(one-half day or less) 

• Work expands to fill time available 
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Summary 


In general, over a wide variety of situations GSS use does not increase 
participant satisfaction. Once again, I found this surprising because this is a 
benefit claimed by many users and vendors of GSS technology. 

There are at least two possibilities which may explain this anomaly. 


When Does GSS Improve 
Performance? 


Participant satisfaction is improved: 
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Summary 

One statistically supported possibility is that satisfaction is only improved for 
large groups. 

A second, theoretically more powerful possibility, which I believe to be true but 
cannot prove, is that there is a ceiling effect; satisfaction is a hygiene factor. The 
term hygiene factor comes from the idea that some factors can only “hurt.” A 
super clean restroom in a restaurant will not increase your satisfaction of 
visiting the restaurant and increase the chance you will return, but a dirty 
restroom might decrease satisfaction. GSS is just a tool, and in general, one can 
never be more than “satisfied” with a tool. However, if the tool does not fit the 
task (you need a hammer when you have a screwdriver) you can become 
dissatisfied. The satisfaction differences found for large groups may reflect the 
fact that non-GSS groups are extremely dissatisfied with their process, and thus 
GSS groups, which are merely satisfied, are significantly better. 


When Does GSS Improve 
Performance? 

Participant satisfaction is improved: 

• In general, never 

Possibilities: 

• Satisfaction is improved for larger groups 

• Satisfaction is a hygiene factor in that there 

is a ceiling effect : you can be dissatisfied 
but not “ecstatic” from work MIS' 

Terry 
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Bottom Line Advice 


Since GSS groups outperform non-GSS groups in the quantity and quality of 
ideas in a wide variety of settings, GSS should be used for idea generation 
wherever possible. 

Decision making is more tricky. GSS should be used only for large groups 
working in the same room at the same time, when participants discuss issues 
electronically and verbally, and electronic voting is used. A facilitator is 
important when groups use a new GSS tool or perform an unfamiliar task. 

The corollary to this is that it makes sense for groups to discuss issues and 
generate ideas over the web, but when it is time for a critical decision, they 
should come together face-to-face. It may be possible to use newer video- 
conferencing technologies, or just those that provide audio (e.g., conference 
telephone call), but this may be risky. 


Bottom Line Advice 

• Use GSS to generate ideas wherever possible 
(e.g., same room or on the Web, large or small 
groups, with or without a facilitator) 

•Use GSS to make decisions 

- when a large group works together in the 
same room at the same time 

- use electronic voting, and both electronic 
and verbal discussion 

- have a facilitator when using new tools 
or processes 
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If You Have a Pilot Project to Test GSS 


If you want to succeed: 

• do idea generation 

• find a large group and have them work together in the same room at the 
same time 

• find a dissatisfied group and work with them. 


If You Want to Succeed 

• Do idea generation. 

• Find situations in which people are noticeably 
dissatisfied with the current work processes. 

• Find a large group task lasting a day or more, 
in which participants will work together in the 
same room at the same time. 
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If You Have a Pilot Project to Test GSS 


If you want to fail: 

• have a small group 

• use a GSS new to them 

• over the Web 

• on an unfamiliar task 

• without a facilitator. 


If You Want to Mess Up 


have a small group 


use a GSS new to them 


over the Web 


on an unfamiliar task 


without a facilitator. 

MIS : 

Terry 
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Meetings in the Next Century: Any Time, Any Place 


L. Floyd Lewis 

Professor of Information Science 
Decision Science Department 
College of Business and Economics 
Western Washington University 
Bellingham, WA 98225 

A variety of Group Support Systems (GSS) have been developed over the last fifteen years 
to help improve the process of group decision making and problem solving. MeetingWorks 
for Windows is a GSS that provides a comprehensive and flexible set of tools that can be 
used to design a wide variety of meeting processes. The tool set includes modules for idea 
generation, list discussion and organization, item comparison and cross-impact analysis, 
evaluation of alternatives (selecting, ranking, rating), and multiple criteria 
analysis. Traditionally, these tools have been used to support face-to-face meetings (same 
time/same place). Recently, new versions of MeetingWorks utilize the communications 
capabilities of the Internet to allow for participation from remote sites at varying times. This 
allows for different time/different place meetings, as well as same time/different place 
meetings. These capabilities will become increasingly important as organizations become 
more geographically dispersed and integrated through telecommunications networks. 


Meetings in the Next Century: 
Any Time, Any Place 



L. Floyd Lewis 

Professor of Information Systems 
Decision Science Department 
College of Business & Economics 
Western Washington University 
Bellingham, WA 

s' 

meetingworks' 
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What Are Group Support Systems? 


A Group Support System (GSS) includes computer hardware, specially-designed software, and 
unique procedures that allow a knowledgeable group facilitator to design processes to support 
group decision making and problem solving. This can be an effective method for improving group 
decisions, and often involves discovering new dimensions to the problem, and/or finding new 
approaches to solving problems. Group support systems are ideally suited for situations where 
organizations engage in repeatable processes. A GSS can be used to “capture” a process, and then 
help ensure the same approach is used each time the process is repeated. The participatory team 
orientation of a GSS can be a powerful agent of cultural change in an organization. It can also be a 
barrier to adoption in organizations that do not have a commitment to a participatory approach. 
Most of the comments in this presentation relate to the use of a particular GSS system: 
MeetingWorks for Windows. 


What Are Group Support Systems? 


What a GSS is: 

♦ A tool for deliberately 
designing a meeting 
process 

♦ A tool to help improve 
decisions 

♦ A tool for “discovery” - 
about problems; about 
solutions 

♦ An enabler of repeatable 
processes 

♦ An agent for corporate 
cultural change 



list aj 


usta 




j 1» IDfOlB » «] «] fRTIFTtgl M i t il * §f»T” 

f> rtsi 













What is a Face-to-Face GSS Meeting Like? 


The GSS process usually begins when a knowledgeable GSS facilitator holds a discussion with 
someone who wishes to initiate a meeting. When the purpose and desired outcomes are clearly 
articulated, the facilitator (possibly aided by a technical assistant or “chauffeur”) will design a 
meeting agenda which incorporates some of the GSS tool modules at appropriate steps. When the 
GSS meeting takes place, the participants typically gather in a decision room where at times they 
may enter ideas and/or numeric evaluations through a computer. Most GSS meetings also include 
some face-to-face oral discussion about the ideas or evaluations that have been submitted. At 
times, a display of some kind (like a summary list of ideas, or a graph showing the results of an 
evaluation) may be projected to a screen at the front of the room, and the facilitator often leads a 
discussion of this material. Typical meetings may flow back and forth several times between these 
types of activities during one or more sessions. 


What is a Face-to-Face 
GSS Meeting Like? 

1 . A meeting initiator meets with a facilitator to 
articulate the desired outcomes and purposes of 
the meeting. 

2. A facilitator/chauffeur team map meeting tasks to 
MeetingWorks tools. 

3. At times during the meeting, participants may 
enter ideas and/or evaluations into a laptop or 
desktop computer. 

4. At other times, the group may engage in verbal 
discussions of the ideas or evaluation results. 

5. Summary list or graphs are displayed to 
participants, and the facilitator leads a 
discussion to assure common understanding 
and clarity. 
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Meetings Classification Framework 

Most GSS meetings have taken place in a face-to-face mode, where participants meet in the same 
place at the same time. However, the rapid growth of the Internet has made it possible to support 
other modes - different times and/or different places. One version of MeetingWorks (the 
InternetEdition) now supports meeting processes where participants can log into a web site at 
different times from different places using a standard web browser. This could be appropriate 
when participants are asked to contribute a list of ideas for later discussion, or to rate a set of ideas 
that they have previously discussed. Another new version of MeetingWorks (Connect) can be used 
when some participants are unable to attend a live meeting, but they may be able to connect via the 
Internet during the meeting. They can then contribute material, evaluate ideas, and even see the 
summary results of the meeting in real time using a standard web browser. Teleconferencing may 
be especially useful in supplementing this mode. These distributed GSS approaches are especially 
useful for supporting virtual teams that may be geographically dispersed. 


Meetings Classification Framework 


Same Place 


Different Place 


Same 

Time 


Different 

Time 


MeetingWorks for 
Windows (LAN) 


MeetingWorks Connect 
(Internet Browser) 



MeetingWorks for 
Windows (LAN) 


MeetingWorks 
InternetEdition 
(Internet Browser) 
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What is a Distributed (Web) GSS Meeting Like? 

A distributed GSS meeting will start out just like a face-to-face meeting, with a discussion 
between the meeting initiator and a facilitator. However, when GSS tools are mapped to the 
process steps required by the client, some or all of the tools will be Internet-enabled. Participants 
will be told that they can complete certain steps by logging on to a particular web address with 
their browser. Typically, a time frame is given such as “please contribute to the list of product 
requirements by 5:00 p.m. Thursday.” Participants can then control the time and place of their 
involvement. If a step requires a face-to-face meeting, but not everyone can attend, a tool version 
can be used that allows a remote group member to participate in real time over the Internet. In this 
case, the remote participant can contribute ideas and evaluations, and will see the group summary 
displays on their own remote systems as soon as the face-to-face participants do. 


What is a Distributed (Web) 
GSS Meeting Like? 


MeetingWorks for 
Windows (LAN) 


MeetingWorks 

Connect 

(Internet Browser) 


1. A meeting initiator meets with a 
facilitator to articulate the desired 
outcomes and purposes of the meeting. 

2. A facilitator / chauffeur team maps 
meeting tasks to MeetingWorks tools. 

3. For some steps, participants use a standard 
browser to log into a meeting website to enter 
ideas and/or evaluations at different times/places 

4. The group may use chat, email, threaded discussion tools, or a 
face-to-face meeting to discuss the ideas or evaluation results. 

5. Summary lists or graphs are displayed to local and remote web 
participants, and the facilitator leads a discussion to assure 
common understanding and clarity. 



MeetingWorks 
InternetEdition 
(Internet Browser) 
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Special Concerns of Distributed GSS Meetings 


Distributed GSS meetings are not the same as face-to-face meetings - they have their own unique 
advantages and challenges. In a different time/different place meeting where all participants are 
dispersed, it is more important but also more difficult, to communicate clearly about what is 
needed in each step of the process. A facilitator tries to do this with clear written instructions, but 
handling the inevitable questions by email and phone is not as satisfactory as immediate verbal 
interaction in a face-to-face setting. If the group has never met face-to-face, it may be hard to 
provide for social interactions that can help the group develop a sense of identity and shared 
purpose. It may be easier for some members to “drop out” in a distributed meeting, especially if 
they do not feel a sense of connection. The facilitator may have to work harder to encourage 
participation. If the group will be using audio and/or video conferencing, the management of these 
additional technologies add to the complexity of the process, and may tax the ability and energy 
of the facilitator. Developing new techniques for facilitating distributed meetings should be a high 
priority in the near term. 


Special Concerns of 
Distributed GSS Meetings 

♦ Accurate and timely communication 

- Between facilitator and participants 

- Between participants 

♦ Developing social interaction and a sense of 
group identity 

♦ Assuring participation 

♦ Managing complex multimedia 
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What Kinds of GSS Meetings Can You Hold? 


The key word here is “variety.” A typical GSS tool set is generic and fundamental, and can be 
used to develop an endless number of different meeting processes. In some ways, asking what 
kinds of meetings you can hold with GSS is like asking, “what can you write with a pencil and 
paper?” The list on this slide contains examples of GSS meetings already successfully held; it is 
not a complete list of all possible meetings. This general purpose characteristic of GSS can make 
it hard to describe to those unfamiliar with the tools. Saying that something can do “anything” 
may make it sound like it does nothing in particular! A related problem is that someone who 
attends a demo of a GSS is understandably likely to go away thinking of GSS as “the system that 
does what I just saw in the demo.” If any generalization can be made it is probably that GSS is 
most often used in meetings where the purpose includes some type of planning. 


What Kinds of GSS 
Meetings Can You Hold? 


Action Planning 
Annual Business Meeting 
Choosing By Advantages 
Competitive Analysis 
Control Self-Assessment 
Focus Groups 
Idea Generation 
Joint Application Design 
Market Analysis 
Monthly Update Meeting 
Organizational Design 
Visioning 
Portfolio Review 


Process Reengineering 

Project Implementation 
Planning 

Project Planning (Kick- 
off/Checkpoint/Evaluation) 
Project Prioritization 
Quality Initiatives 

Software Development 
Project Reviews 

Strategic Option Analysis 
Strategic Planning 
Team Development 
Values Analysis 
Vendor/Product Selection 
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What Are Some Potential Benefits? 


Over the years, a number of benefits have been found to potentially result from GSS use. Not all 
benefits are forthcoming from every meeting. In reality, given .the complexity of meeting 
processes, none can be absolutely guaranteed for a particular situation. However, most GSS 
sessions do result in some of these benefits, sometimes most of them. The list shown here includes 
benefits that have been identified by MeetingWorks users in their meetings over the last ten years. 
Many report that GSS meetings can be more effective - more likely to achieve the goal of the 
group. Others find that over an entire process (which may include multiple GSS sessions), 
significant efficiencies can result. Some of the features of a GSS (like anonymous keyboard entry 
of ideas and evaluations) may encourage more participation by members who might be reluctant 
to speak up in a traditional meeting. Some have observed that this can reduce destructive conflict 
in groups, which could lead to greater buy-in to a final decision. The Internet features provide new 
forms of support for virtual teams. Clients with group processes that are repeated on a regular 
basis like the way a GSS can capture these processes and make them available throughout an 
organization. 


What Are Some Potential Benefits? 


♦ Improved meeting effectiveness 

♦ Improved meeting efficiency 

♦ Increased participation 

♦ Enhanced ownership and buy-in 

♦ Improved support for distributed or virtual teams 

♦ Fewer destructive impacts from conflict and power 
differences 

♦ Repeatable processes 

♦ Instant documentation 
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Process Overview 


As a first step, the AgendaPlanner tool allows the facilitator to create a custom agenda for a group 
process that may take one or more meetings and may include one or more steps using the Internet. 
The Generate tool is used to gather text material from participants (e.g., a brainstormed list of 
solution alternatives, or a set of critical comments about a marketing plan). The Organize tool is 
used to process initial raw lists by editing and structuring the lists into outlines. Several 
approaches to evaluation are available - voting, selecting, ranking, rating, etc. For complex or 
mission-critical decisions. Multiple Criteria Analysis allows the group to define and weigh the 
importance of multiple criteria for a decision and then apply the criteria to multiple alternatives. 
The Cross-Impact tool can be used to compare any two lists of ideas (e.g., indicate the likely 
impact from each policy option on a list of stakeholders). Any Windows-compatible software 
can be added to a MeetingWorks agenda. This allows a facilitator to bring spreadsheets, 
databases, documents, etc., as needed into a meeting. When a meeting starts, the agenda is 
executed step-by-step by using the Chauffeur tool. Ad hoc steps can be included during a meeting 
as the need arises. An example of a short GSS meeting agenda for an automobile “fleet purchase” 
is shown on this page. The next few slides show the MeetingWorks tools in use for the Multiple 
Criteria step of this agenda. 



Before the meeting, use 
AgendaPlanner to create or 
modify an agenda choosing 
from a number of tools: 

• Generate 

• Organize 

• Evaluate 

• Multiple Criteria Analysis 

• Cross Impact 

• External link (Word, 

Excel, Access, etc.) 


When the meeting starts, use 
Chauffeur to run an agenda: 

• Run pre-planned steps 

• Create and run ad hoc steps 

• Manage Internet meetings 

• Manage meeting data 


^MeetingWoiks - AgendaPlanner 


Efe £<# Options Window ftdp 

SMM) [j^PWei m&\ lain 


cm 


> Agenda - C:\MWW\DATA\FLEET.AGD 


Generate 


Opening Presentation 


List the Cars' Strengths and Weaknesses 


Organize 


Mult. Crit. 


Discuss the Strengths^eaknesses 


Evaluate the Alternative Automobiles 
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Creating A List of Potential Criteria with the Generate Tool 


This slide is a screen capture of the display projected to the front of the room during the use of the 
Generate tool. Meeting participants were asked to contribute to a list of goals or potential criteria 
that could be used to select the best automobile for the company. Each participant would type an 
idea on their own computer, then send it to a common shared group list (as shown below). This 
list is typically projected onto a screen at the front of the room, which helps reduce redundant 
contributions, and allows participants to “piggyback” on each others ideas. While this example 
shows Generate being used for a single topic, it is also possible to have multiple topics defined 
for a Generate step. Participants can then choose and move between topics depending on their 
interests and rate of input. 


MeetingWorks/W - Generate Version 2,1a 


File Options Help 


Continuous View 

Please enter a list of GOALS relevant for automobile buying 


Ldzi 


1 . Adequate space for hauling the sample equipment around ^ 

2. Provide comfortable transportation for salespersons & g 

customers £L 

3. Low initial costs 

4. Keep the operating costs (fuel, lubrication, repairs, etc.) as gg 

low as possible W 

5. Passengers must be safe at all times m 

6. Reliable cars. If 

7. The cars should represent the company (image) to our 

customers. ip 

8. Keep the cars off the road and out of the shop! g- 

9. Low gas consumption. fg 

10. Should be comfortable and easy to drive. jj 

1 1 . Must be easy to load / unload the equipment when we gg 

have a demo at a customer site. m 


Si 
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Using the Organize Tool with the Initial List 

Initial raw lists typically need a fair amount of discussion, editing and organization. The 
MeetingWorks Organize tool helps the group with this process. The approach shown in this 
example uses a two part display. At the top, each idea from the original list is presented, one at a 
time. To help manage the group’s time budget, this window shows how many ideas remain on the 
list, how much time remains for working with the current item, and an estimate of the amount of 
time remaining to complete the list. While an item is display in the top section, the group will 
verbally discuss it to reach a common understanding of the meaning, and may edit or delete it as 
appropriate. When an idea has been processed, it can be added to the outline in the bottom half of 
the window. This allows the group to work with the structure of the ideas as well, by the way they 
are organized in the outline. 


Item discussion 
Is this item: Clear? 

Appropriate? 


Edit the topic text and select the item to be added to the results window 


Reliable cars. 


Items I Jime I — JEttimated time 

Remaining: J 6 Remaining I ~*° complete the 1 1 8min 

M — list: 


Discussion Item 


Unique? 

Singular? 


&dd at fits! level 



MeetingWorks/W - Organize Version 2.1 a - [Discussion Mode Results] 


File Edit Actions Tools Options Window Help 


(1 Provide adequate space for transporting sample equipment 

_J2 Provide appropriate transportation for salespersons & customers 
3 Costs 

J3.1 Low initial costs 


|3.2 Low operating costs (fuel, lubrication, repairs, etc.) 


4 Passengers must be safe at all times 


Mode 1 Discussion Time I 4;34 
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Assigning Weights to Evaluation Criteria 


This screen shows a typical summary display for an evaluation. This example is part of a step 
where participants were asked to distribute 100 points between five criteria to indicate their 
relative importance. The table and graph summarize the same information in two forms. The 
criteria at the top of the list (Life Cycle Cost) achieved the highest average weighting, and is 
also shown as the highest blue bar on the left side of the graph. The level of variability in the 
scores is also shown in the table. This measures the spread in the scores assigned by the 
participants. If every participant gave the same score to each criteria, the variability would be 
very low - zero in fact! As participants assign different values to the criteria, the variability 
score will rise to a maximum of 100%. The red bars on the graph show the variability scores. 
This can allow a group to quickly identify areas of disagreement where further discussion is 
needed. When entering their weights, participants can enter a comment for each item, 
explaining their rationale for the evaluation. This information is then available while viewing 
the summary results, though the identity of the author of the comment is not revealed. 
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The slide shown below is a screen capture of the summary display in the Multiple Criteria 
Analysis tool. Using the criteria defined in the previous steps, participants evaluated several 
alternatives. Each alternative is rated on each criteria. Then the software combines all the criteria 
weights and alternative ratings for all participants to produce the summary tables and graphs 
shown here. Summary displays like this make it possible to manage complex issues and to 
understand why various alternatives do well or poorly. This kind of analysis is likely too 
complicated to attempt using manual methods like blackboards or flipcharts. Once the original 
evaluation is completed, the Multiple Criteria Analysis tool allows the group to explore the 
results further, changing specific weights or ratings to see what difference it might make in the 
final decision. This sensitivity analysis deepens the understanding of the group and allows them 
to see the robustness of the decision. 


MeetingWorksAV Multiple Criteria Analysis - Version 2.1a 


Ele .Options fiesults Window Help 


Average Criteria Weights 


Results Detail: (Group Mean) 


Graphic result 


m 


(Criteria) 


Life-cycle cost 26.7% 

Reliability 21.7% 

Suitability for passengers 25.0% 

Suitability for transporting mat ! 1 8.3% 

Appearance / Image 


1( Average ))( Variability) 


34.0% 
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R0% 

5.0% 


8.3% 
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Results Table 


Display Option; 


Final Results (Group Mean) 
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Weighted Averacies 


l^ternatlve) | Life-cycle cost| Reliability | Suitability for passengers | Suitability for transpo... |Appearance..J Total' 
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El 
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26.7 

0.0 

12.9 

■ 

9.8 

; 

T1 

50.5 

El 

Honda Accord 

15.1 

21.7 

13.8 


7.9 


6.8 

65.3 

a 

Mitsubishi Wagon 

16.0 

10.8 

20.0 


18.3 ~ 


4.6 " 

: 69.8 

£S 

Nissan Pulsar NX 

20.0 

3.3 

0.0 


0.0 


1.0 
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Agenda for Distributed GSS Session 

If a group decides to hold distributed sessions through the Internet, they would use a standard web 
browser to log into a site for the meeting. The screen below shows what the participant would see 
if they were using MeetingWorks IntemetEdition to work on the fleet purchase problem. A 
participant who is familiar with this tool would click on the control buttons or use the function 
keys to register for the meeting and then carry out the steps in the agenda. A novice might click 
the “Guide Me” button, which takes the user through the same process in a step-by-step fashion. 
No software installation is required at the participant station beyond the standard web browser. 


t > *» - H 3 £5 ]3j5i Jj 


jFleet Purchase 

Meeting Description 
{Meeting Instructions 
Final Listmctious 


Crtfe Me 


Select each step on the list (one at a time), and click Run Step 
jThen enter your responses and dick Send 


Strengths and Weaknesses 


Evaluate the Alternative Automobiles 


m 

m 


()F2)*»R*gi*Uf (F4}»RunSUp {FIQJ-Doo* 


Help I Foot; WB 


Copyn^W C 19974 EnUtpii## Sotvjuam. lac 


Meeting Description 

This is a MeetingWorks agendato kelp this task force select the right automobile for our next fleet purchase We will 
generate a list of adv antages and disadvantages, and discuss/organize die list. Then we will use a Multiple Criteria tool to 
determine which is die best alternative. 

Back to Participant Screen 


Meeting Instructions 

Tliis is a MeetingWorks Internet meeting document. At the top of diis web page, you will see a MeetingWorks Internet 
Participant screen that will let you access the meeting agenda 
The first tiling you must do is register: 

• Click Register The Registration dialog box displays 
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Using the InternetEdition to Enter Criteria Weights 


This screen captures the display a participant sees when using the InternetEdition to enter criteria 
weights for the fleet purchase problem. By using a mouse or arrow keys, a participant can move 
up and down to enter values for the weights. In addition, a participant can enter a comment for 
each item, explaining their rationale for the evaluation. This information is then available while 
viewing the summary results. The user interface is kept clear and simple, and as close as possible 
to identical with the version used in a face-to-face meeting, so there is no additional learning 
required of the participants. On line help is available at all times, as can be seen from the 
command buttons at the bottom of the screen. 
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Instant Final Report 


MeetingWorks provides support for the easy production of sophisticated reports at the immediate 
end of a GSS session. Using the tools provided in MeetingWorks, along with a word processor like 
Microsoft Word, a facilitator can prepare a document shell prior to the meeting. This shell simply 
describes the meeting data the facilitator wants in the final report. After the meeting, the 
facilitator can simply execute the macros contained in the document shell, and the software will 
gather the information from each step in the meeting (including graphs and tables), add it to the 
document, format it appropriately, and print a finished report. Rather than wait for two weeks for 
someone to type up the minutes of the meeting, a full report is available immediately at the end of 
the session. 


Instant Final Report 


Use Word processor to create or modify a meeting 


document “shell”: 





Select meeting steps 

Insert any other text or 
files 

Use your desired format 


A set of Formatting commands (macros) will format 


meeting data in your final document: 



• Electronic flip chart contents 

• Graphs & tables 

• Participant comments 


82 



MeetingWorks Strengths 


While all GSS systems share many common features, each has some unique strengths as well. 
One of the major strengths of MeetingWorks is its modest requirements for computer hardware. 
Low-end Windows PCs work fine for participants, with a more powerful Pentium system to act as 
a network server and chauffeur station. MeetingWorks is designed to work very well with 
wireless LANS. The software is also compatible with virtually all network operating systems, 
giving users great latitude in the choice of their preferred NOS. If a group process would benefit 
by moving back and forth between face-to-face and distributed meetings, it is simple to 
implement since all the MeetingWorks tools are compatible, and the results of any step can be 
moved to any other tool module. It is also possible to use other Windows software with 
MeetingWorks, and to move meeting data into other programs for further processing. Meeting 
output can saved in multiple formats such as HTML, JPEG, MS Excel, MS Project. Allowing 
participants to enter qualitative explanations of their quantitative evaluations improves the group’s 
understanding of the evaluation process. A major design emphasis of MeetingWorks continues to 
be the provision of a simple and intuitive user interface for participants. The software can be 
evaluated for free by downloading a version limited to 8 participants from the web site. 

MeetingWorks Strengths 


♦ Light on system requirements 

♦ Powerful reporting capability 

♦ All MeetingWorks products work together 

♦ Integration with other software 

♦ Quantitative and qualitative data 

♦ Simple interface for participants 

♦ On-line help and user manual 

♦ Trial download from web site 
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Sample of Clients 


MeetingWorks is a mature product that has been in continuous development and use for over 
fifteen years. It has been used by real clients in thousands of meetings to solve real problems and 
make real decisions. A partial list of MeetingWorks clients illustrates the range of companies that 
have found it useful. 
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For Further Information 


Further information about MeetingWorks, including a free downloadable evaluation version, can 
be found at the following web site: 

www.meetingworks.com 
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Munir Mandviwalla 


Comparison, Evaluation & Development Lab 
Temple University 
Philadelphia, PA 19122 


mandviwa@temple.edu 


http://www.cis.temple.edu/ced 


Collaboration Technologies: 
New Directions and Issues 


Munir Mandviwalla 

Comparison, Evaluation, & 
Development Lab 

Temple University 



What is a Collaboration Technology? 

A collaboration technology is a way to describe technologies that are labeled as 
Groupware (e.g., Lotus Notes), Electronic Meeting Systems (e.g., GroupSystems), 
Conferencing (e.g., NetMeeting, chat), Knowledge Management and Organizational 
Memory Tools (e.g., Lotus Notes). There has been quite a bit of research in this area 
in various disciplines, and as a result, each discipline has a slightly different term and 
perspective on the technology. 


What is a collaboration 
technology ? 

■ A way to describe technologies that are 
labeled as: 

■ Groupware (e.g., Lotus Notes) 

■ Electronic Meeting Systems (e.g., 

GosjipSysteiiis ) 

■ Conferencing (e.g., NetMeeting, chat) 

■ Knowledge Management & Organizational 
Memory Tools (e.g., Lotus Notes) 
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New Directions 


It is time to consider new directions for collaboration technology. These new 
directions are needed because new technology is becoming available, thus 
providing new opportunities. The needs of users are changing and they are 
demanding fresh or revisited applications of the concept. 




Remote Presentation 


One example of a new direction and use of collaboration technology is remote 
presentation - where a presenter can show a slide to a large number of distributed 
users. The presenter can annotate the slide and draw on it along with using polling 
features. Users can interact with the presenter through chat based voice 
conferencing tools built into the remote presentation tool. The screen print below is 
from a product called Placeware. 
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More on Remote Presentations 

In one sense a remote presentation tool is a collaboration tool because it includes 
chat, whiteboard, polling, and telephone conferencing technologies. All of these 
technologies are fundamental to collaboration technology. 


More on remote presentations 

Y///////////////////////////////////////////////W 

■ Is th|is really remote presentation? 

■ Web enabled Presentations 

■ Chat 

■ Whiteboard 

■ Polling 

■ Telephone conferencing 
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Summary of Results 


We are applying and studying remote presentations at the CED Lab at Temple 
University. The projects include experimentation as a distance learning tool. Early 
results indicate that the students prefer this approach. Another project has to do with 
applying business process redesign concepts to education and matching learning 
processes with technologies such as remote presentation. 


Summary of Resu lts 

■ Curriculum Initiatives 

■ Experiment with hybrid distance learning models 

■ Early Results: It is possible and the customers 
prefer it 

■ Learning Process Redesign Project 

■ Model education as a series of learning and 
administrative processes 

■ Example: Question and Answer, registration 

■ Results: Framework for application, new way of 
thinking 

■ Online learning as a cognitive process 
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Large Scale Professional Meetings 

Another interesting area of application for collaboration technology is in large scale 
professional meetings - conferences, workshops, and other professional gatherings. 
This is a large untapped area of application. There are some compelling underlying 
factors that suggest the importance of this area. 



Large Scale Professional 
Meetings 

Computer Supported Professional Meeting 

■ In 1991, approximately 80 million people 
attended meetings in the United States at 
a cost of about $38 Billion 

■ underlying factors 

■ Increased costs 

■ Increased need to interact 

■ Available technology 

■ Community imperative 
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Professional Meeting Technologies 


Examples of professional meeting technologies include applying existing tools such 
as text based chat or bulletin boards, and new audio conferencing tools mixed with 
streaming video. The most interesting are hybrid schemes, some of which overlap 
into the area of remote presentation. 


Professional Meeting 
Technologie s 

■ Text chat and bulletin board: O'Reilly 


■ Audio Conferencing 

■ Streaming Video 

■ Hybrid schemes: integrate presentation with 
chat & audio 

> Rendezvous 

■ Remote Presentation? 




IS World Net Virtual Meeting Center 


The screen shots below show an experiment for the ISWorld virtual meeting center 
(VMC) (http://www.isworld.org/vnKri . The VMC hosts short conferences and 
workshops for professionals in Information Systems. Starting from the top left, the 
first screen shows the login screen, followed by the list of individual conferences 
available and then, finally, the contents of one particular conference that is 
currently in progress. What is interesting about this project is that it is a new 
application of a widely used technology. 


ISWorld Net Virtual Meeting Center 


-i'jm ihU'rOfl f. 
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Summary of Results 


The screen below shows our results with this technology. The key result is that the 
application seems to be most useful for people who are very far away from each 
other, such as on different continents. 
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Electronic Scholarship 


Another new application of collaboration technology is in electronic scholarship; 
specifically, the area of electronic publishing and refereeing. This presentation will 
concentrate on the peer review process which is viewed as a basic collaborative and 
communicative process. 



Electronic Sc holarship 


■ Electronic Publishing 

■ Electronic Refereeing 

■ Fundamentally a collaborative and 
communicative process 





Temple Peer Review Manager 


The screen below shows the Temple Peer Review Manager (TPRM) 
(http://peerreview.temple.edu). TPRM is a web-based knowledge management 
software that automates and changes the process of managing and reviewing 
documents such as scholarly articles. TPRM is also useful for contract review, grant 
review, and any other activity that is centered on the submission and review of 
documents. 


Temple Peer Review Manager 
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An Individual Review 


The software enables an author to submit a document electronically to a publication 
such as a journal or conference. A managing editor appoints senior and associate 
editors who coordinate and track the reviewing process. Appointed reviewers 
download the article, submit comments to an electronic bulletin board, and respond 
to other reviewer’s comments until the senior editor submits his/her report. The 
author can use the system to track the status of the article. The software can be 
customized to existing and new reviewing processes. 


An individual review 


Mlp Z/bdil cis lefliple.ecju/jnsi/Vn:wnev»cws asp?P<jpt;ilO " 1 • Micrustdt Jnl 



| Search] ' '/• ’ My Yahoo* » 1 jj ; * Y‘ Bookmarks 






Tem ple Pe w Review Manager - Main Mena 


j| Iffiew Article j 


(I don't see the fight ( Major Revision ) , (anonymous) , 

(But it is all social ( Accept ). (anonymous) , 

A. 

(I can't understand the importance [ Reject ) . (anonymous) . 

(This is implicitly a very important paper ( Accept ) . (anonymous) , 


'‘Could, this be 
a bulletin 
board? 

What are the 
possibilities? 
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Summary of Results 


The slide below summarizes our results from using and building TPRM. 


Summary of R esu Its 

■ Studies of peer review using new models of 
scholarship 

■ Authors and reviewers the most enthusiastic 

■ Increase in efficiency and satisfaction 

■ Perception of fairness 

■ But is there an increase in quality? 

■ Development of e- refereeing tools 

■ Temple Peer Review Manager is ready for release 

■ Focused on applying collaboration technology 
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Integrative Collaborative Systems 
and Research Methods 

Another new direction for collaborative systems is integrating existing features. 


Integrative Collaborative Systems 
4jL; and Research Methods 

■ To the user 

. LAN <> WAN 

■ groupware <> transaction processing 

■ word processing <> email 

■ presentation <> conferencing 

■ Suggests the need to think formally about 
Integration 

■ BUT: Paradox of IS research 

■ must research objects/issues that don't exist or 
still need work using approaches that assume that 
the object/issue is relatively fixed in nature or 

society 
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Summary of Results 


At Temple we have been developing a prototype integrated collaborative system 
called Collaborative Object Workspaces (COWS) (http://ww2.cis.temple.edu/cows). 
The current COWS prototype integrates multiple mediums such as text and 
graphics, modes such as face to face and distributed, and structures from low to 
high, into a relatively simple user interface based on the Windows 95/NT 4.0 
Explorer. 


Summary of Re sults 

■ Develop a prototype integrated system 

■ Collaborative Object Workspace (COWS) 

■ Integrate medium and structure (text + graphics 
+ categorization) 

■ Integrate mode and structure (asynchronous + 
synchronous + access controls) 

■ Create a research methodology that is based 
on generating theory via prototype 
development 
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cows 


The screen below shows the two major views in COWS - text based lists and 
outlines AND graphical sketch oriented diagrams. Both views refer to the same data. 



COWS 
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The Internet/Ecommerce Push 


Another important area of new collaboration technology is the Internet. The slide 
lists some examples that are based on Internet use including a project by a Temple 
student. 


The Internet/Ecommerce Push 


■ Internet Telephony (e.g., Internet Phone) 

■ Internet Entertainment (e.g., RogarMlco) 

■ Small touch collaboration project 

■ Over Your Shoulder 

■ Utility that at the push of a button publishes an image of 
your desktop on the web 

■ Collaboration Requirements Project 

■ Impact of the Internet and new ways of working 









Summary 


Collaboration technologies are now evolving into new areas and applications. This 
presentation included a description of these areas along with examples of projects at 
Temple University’s CED Lab that are exploring the ideas presented here. 


tSummary 

■ Collaboration technologies have evolved to an 
extent that we can now start thinking about 

■ Integration into "non-colfaborative" technologies 

■ Integration into "non-colfaborative" problems 

■ Integration of the collaboration widgets 
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Process and Outcome Effects of Group Support Systems 

Ajay Vinze 

School of Accountancy and Information Management 
College of Business - Box 873606 
Arizona State University 
Tempe, A Z 85287 

Over the years group support systems have been credited with 
enhancing the quality of group communication. The impact of these 
systems on both the outcomes from group discussion and its effect on the 
process of communication deserves close scrutiny. This research effort 
studies the characteristics of group decision making from an outcome as 
well as a process-based perspective. 

Implications of changes to decisions without changing the underlying 
facts has relevance to most organizations. Group polarization is an outcome 
that has been studied extensively in the social psychology literature. The 
phenomenon has, however, received only limited attention for technology 
mediated settings. 

In this presentation, insights from my previous research, as relevant to 
the polarization context, are provided. The focus of my prior research has 
been on decision making in general . 

Theoretical foundations are provided from both the social and 
psychology literature. A good reference in this context is a meta-analysis 
conducted by Isenberg (1986). 

The results presented here focus on both the outcome and the process 
that describes such an outcome. 
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The Notion of Group Polarization 


Group polarization is the tendency of individuals in a group setting to 
engage in more extreme decisions than their original private individual 
decisions (Myers and Lamm, 1976). The group polarization phenomenon was 
discovered by Stoner in 1961 when he observed that group decisions are 
riskier than private decisions of individuals comprising the group. He labeled 
his observation as, “risky shift.” Subsequent researchers, however, observed 
that changes in group decisions occur in the direction of risk as well as in the 
cautious direction and, as such, this phenomenon has been re-labeled, “group 
polarization” (Myers and Lamm, 1976). 

The implication of group polarization is that group dynamics have the 
potential of changing the group's final decision without necessarily changing 
any of the underlying facts that lead to the decision. Group polarization can be 
viewed as having many potential benefits as well as detrimental effects. A 
number of historic fiascoes have been attributed to group polarization 
including: decisions made by President Nixon’s inner circle regarding the 
handling of the Watergate cover-up (Green and Conolley, 1974), and the 
Challenger space shuttle disaster. On the positive side, group polarization is 
beneficial in group counseling situations such as quitting smoking, diet 
programs, alcoholics anonymous, and for charitable giving situations where 
there is a need for group consensus in an extreme position. 


Group Polarization 


w 


♦ What is group polarization? j 

- Group decisions being more extreme than individual decision 

♦ Why study group polarization? j 

- Can change decisions without changing facts! | 

- Examples from initial efforts with “Audit Risk Assessment” and \ 

“Bank Loan Officers” j 

— Extensive research base on Social-Psychology to draw from | 

♦ Implications of group polarization in a changing work 

environment j 
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Approaches to Group Polarization 

The purpose of this study is to examine group polarization in a 
contemporary context. As critical decisions in organizations are made in task- 
focused teams rather than by isolated individuals, the phenomenon of group 
polarization takes on additional importance. This situation is further 
complicated with the acceptance of group technologies and their potential for 
altering the group interaction. This research synthesizes and draws upon 
frameworks from both the group polarization and GSS literature. 

Three variables appear to be critical determinants of group process and 
outcomes: the communication medium used, the characteristics of the task 
being addressed, and the characteristics of the group (Lim and Benbasat, 1993; 
Dennis, et al., 1988; Bumstein, 1969). Examining this phenomenon from an 
outcome perspective, we report on the effects of communication medium (GSS 
or Face-to-Face), task characteristics (Intellective or Judgmental) and group 
composition (Assertive-Directing or Flexible-Cohering) and their interactions 
on the level and direction of group polarization. To gain insight into the 
nuances of the actual group process, we examine and fiirther analyze the group 
discussion that ensues, for persuasiveness of content in each of the dimensions 
of interest. 


V 

Group Polarization 


♦ Group Polarization: A tendency of group members to make 
more extreme decisions following group discussion 
(Isenberg, 1986) 


♦ Magnitude of polarization 

♦ Direction of the decision shift 

- Risky shifts 

- Cautious shifts 

— 


: 

i 

t 
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Documenting Group Polarization 


Over the past thirty years various researchers have studied group 
polarization by focusing on group discussion and its effect on inducing group 
polarization both at the level of individual opinions - attitude shifts (Hinsz and 
Davis, 1984), and for group decisions - choice shifts (Zuber, et al., 1992). 

An example of a choice shift is evidenced when strategic plans are 
crafted for organizations using expertise from various functional areas; 
production and sales may have contradictory goals and yet must agree on a 
common plan that will meet both their requirements (Ackoff, 1967). On the 
other hand, interest in attitude shift occurs when studying situations where 
individuals consult with others and yet make their own final decisions, like 
when buying a car, a house or other items where individuals collect 
information from others but choose to use or ignore the information collected. 
While the development of GSS is quite independent of the debate between 
choice and attitude shift, it is reasonable to suggest that a purpose of this 
technology is to provide communication and decision support to allow groups 
to share a vision, build consensus and make joint decisions (Nunamaker, et al., 
1991). It can further be argued that GSS can be used to forge joint group 
decisions regardless of whether individual personal preferences agree with this 
joint decision. Given our interest in common group decisions in organizations, 
the more intense group dynamics associated with reaching a common group 
decision (Heath and Gonzalez, 1995), and the capability of GSS to provide 
groups with the means for reaching these joint decisions, in this presentation 
we specifically focus on choice shift as a measure of group polarization. 



Documenting Group Polarization 


♦ Choice Shifts versus Attitude Shifts 

- Choice shift: Difference between mean individual decision before 
group discussion and group’s consensual decision 

- Attitude shift: Change in an individual’s pre-discussion and post- 
discussion preferences 

♦ The focus of this study is on Choice Shift 

- Heath and Gonzalez (1995) suggest that group dynamics are more 
pronounced when there is a single final outcome of the group 
process 
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Theoretical Foundations for This Study 

Several theories have been proposed as explanations for group 
polarization (see Lamm and Myers, 1978, and Pruitt, 1971 for extensive 
reviews). In a meta-analytic study of this phenomenon, Isenberg (1986) 
indicated that there are two viable explanations, the Social Comparison 
theory and the theory of Persuasive Arguments, that need further 
examination. 

The theory of Social Comparison (Baron and Roper, 1976, and Brown, 
1965) suggests that changes in group decisions result from normative 
influences that occur due to an individual’s desire to conform to the 
expectations of the other members. 

The theory of Persuasive Arguments (Bumstein, 1982, Vinokur and 
Bumstein, 1978), the more prominent of the two theories, focuses on 
information collection (Heath and Gonzalez, 1995). This theory suggests 
that shifts in group decisions result from sharing relevant and factual 
information about the situation at hand. 


— 

Theoretical Foundations 

I 

Group Polarization j 

♦ Social Comparison Theory (Brown, 1965) j 

- Focus on Normative influences j 

♦ Persuasive Arguments Theory (Myers and Bishop, 1971) j 

- Focus on Informational influence j 

Group Support Systems j 

♦ Effects of structure and functionality on process and \ 

outcomes j 

{ 
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Key Features of GSS Related to the Group 
Polarization Phenomenon 

GSS research has reported differences in group decision outcomes when 
comparing GSS meetings with FTF meetings (Jessup, et al., 1990). A premise 
of such GSS research is that the difference in the outcomes when comparing 
GSS with FTF meetings results from the significant differences in the process 
of decisionmaking provided by the GSS environment when compared with the 
FTF environment. Two features of GSS that can cause differences in group 
process and outcomes are anonymity and parallel communication. 


"V 


Group Support Systems 


♦ Provide support and structure to exchange of ideas, 
opinions and preferences within a group 

♦ Two features most closely associated with benefits that 
GSS provide are: 

- Anonymity 

- Parallel communication 


-Mr 
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Impacts of GSS 


The introduction of anonymity in a group process can have contradictory 
effects. On the one hand, anonymity decreases conformance pressure 
(Valacich, et al., 1993, and Nunamaker et al., 1991) for the participants in a 
group setting, and allows participation based on content of communication 
rather than the source that generated the communication. On the other hand, 
anonymity has the potential to cause free riding whereby some members of a 
group rely on others to accomplish the group goals (Nunamaker, et al., 1991, 
and Diehl and Stroebe, 1987). 

In addition to anonymity, GSS also provides parallel processing 
capabilities (Nunamaker, et al., 1991) which can also affect (both positively 
and negatively) the group discussion and the informational influence processes 
at work. The feature of parallel communication should prove to be a liberating 
experience for most group members. The ability to contribute without having 
to wait or take turns to present a point of view, and potentially lose a train of 
thought, typically increases the total number of arguments generated. GSS 
researchers have similarly suggested that individuals tend to not only create a 
greater number of total arguments but also are more creative and novel in their 
problem solving (Nunamaker, et al., 1991). Building on this foundation of 
work, we are interested in studying whether the functionality afforded by GSS 
affects the process and outcomes of group decision making when studying 
choice shifts. 




Impact of GSS Features 

♦ Anonymity 

- Decreases conformance pressure (Valacich et al., 1992) 

- Group interaction is more task oriented rather than personality 
oriented (Stasser, 1 992) 

- Reduces “evaluation apprehension” (Bostrom and Anson, 1988) 

♦ Parallel Communication 

- Greater number of alternatives are considered (Dennis et al., 1991) 

- Reduces undue “social domination” (Nunamaker et ah 1991) 
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The Research Model 


The research model blends together explanatory constructs from the 
group polarization literature with the contemporary context afforded by the 
GSS technology to explain group polarization. This model holds that task 
characteristics and group composition have a direct bearing on group decision 
processes and outcomes, as stated by both GSS and group polarization 
researchers. Furthermore, the model posits that GSS will have a direct effect 
on group polarization and more importantly, that the relationship of task 
characteristics or group composition with the decision process and outcome 
will be a function of the communication medium used. In this study we focus 
on the following questions: 

1. Is group polarization only a function of task characteristics and group 
composition? Or does medium of communication play a role in the outcome 
and process? In particular, 

a. Do groups polarize in both FTF and GSS settings? 

b. Is persuasiveness of arguments preceding the group decision 
different when comparing FTF and GSS groups? 

2. How does “communication medium” moderate the relationship of task 
characteristics or group composition with the degree of polarization and the 
level of persuasiveness of arguments? 



118 







Independent Variables 


For Medium in this study we compare face to face decision making with 
GSS mediated decision making. The role and importance of GSS was 
mentioned previously. 

The importance of task characteristics on group processes and decision 
outcomes is well documented. Studies have shown that tasks can account for 
fifty percent of the variance in group performance (Poole et al., 1985). The 
relationship between task and group polarization was first eluded to by Laughlin 
(1980) when he proposed a group-task continuum. At one end are Judgmental 
tasks which entail achieving group consensus on tasks that involve “judgmental 
behavioral, ethical or esthetic judgments for which there are no demonstrably 
correct answers” (Kaplan and Miller, 1987, p. 307). At the other end are 
Intellective tasks that involve a demonstrably correct solution. For Intellective 
issues, the group’s task is to uncover the correct answer. 

The role of group composition has been emphasized in the GSS and group 
polarization literature. In explaining group polarization, Leadership-Confidence 
Theory, Pruitt, 1971 suggests that individuals demonstrating greater 
assertiveness in a group setting are more persuasive in group discussions and 
thereby cause other members of the group to shift toward their initial stance. In 
this study we are interested in how the presence or absence of assertive 
members in a group setting affects the process and outcomes of group decision 
making. 


w 

Independent Variables 

♦ Medium 

▼ Face-to-Face 

▼ GSS 

♦ Task 

▼ Pentium problem (Intellective) 

▼ Business strategy for Intel (Judgmental or Decision Making) 

♦ Group Composition (based on SDI) 

▼ Assertive Directing 

▼ Flexible Cohering 
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Measuring Polarization 


The magnitude of polarization was measured by taking the difference 
between the consensus arrived at in a group decision and the average of initial 
individual deci sions that participants reported prior to the start of the seminar - 
P= I - D. 

The difference indicates the magnitude of group polarization. Higher 
values indicate a larger degree of polarization, the sign indicates the direction 
of the shift. Negative values indicate risky shifts while positive values indicate 
shifts in the cautious direction. 

Note: P= Polarization; 1= Average of initial individual decisions in a group; 
D= Group Consensus 


| l^^V-7.. 1 


V 

Dependent Variable 

1 Group Polarization 

1 (Outcome Orientation) 


i Measured bv decision change 

| ‘Individual - FTF 

| 'Individual - GSS 
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The Hypothesized Relationships 


Hypothesis 1, 2 and 3 focus on the main effects that are studied. The 
focus is on Medium, Group Composition and Task characteristics and how 
they impact group polarization. The relationships are drawn based on the 
theoretical foundations and literature discussed earlier. 


T 

The Hypotheses 

Main Effects 

HI: In GSS settings, groups will demonstrate a lower degree of 

polarization and a lower level of risk when compared with face-to- 
face groups. 

H2: Groups undertaking Judgmental tasks will demonstrate a higher level 
of polarization when compared with groups attempting Intellective 
tasks. 

H3: Assertive-directing groups will demonstrate a higher degree of 
polarization in the risky direction when compared with groups that 
are flexible-cohering. 
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Hypotheses - Interaction Effects 


Hypotheses 4a, 4b and 5a, 5b focus on the interaction effects that are 
studied. The focus is on Medium*, Group Composition, and Task 
Characteristics*. Medium interactions and the joint impact on group 
polarization. As with the hypothesis related to the main effects, these 
relationships are drawn based on the theoretical foundations and literature 
discussed earlier. 


v 

The Hypotheses 

Interaction Effects 


Medium* Task 

H4a: Judgmental, FTF groups will experience the highest level of 
polarization in the direction of risk. 

H4b: Intellective, GSS groups will experience the lowest level of 
polarization in the direction of caution. 


Medium*Interpersonal Styles (Group Composition) 

H5a: Assertive-Directing, FTF groups will experience the highest level of 
polarization in the risky direction. 

H5b: Flexible-Cohering, GSS groups will experience the lowest level of 
polarization in the direction of caution. 


Mr 
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ANOVA - Overall Model Fit 


The experiment was designed as a 2 x 2 x 2 (Task x Medium x Group) 
factorial. ANOVA was used to model relationships between the dependent and 
the independent variables. 

The results suggest at the overall model is valid and statistically 
significant 


ANOVA 


OVERALL MODEL FIT j 

Dependent Variable: Polarization I 


Source 

DF 


Mean 

Square 

KB! 



Model 

MQ 

343.12 





Error 

57 

663.36 

11.64 




Corrected Total 

64 

1006.48 
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ANOVA Results and Significant Means 

Linear contrasts were used to test hypotheses. The dependent variable 
was polarization. The independent variables were: communication medium 
(FTF or GSS); task characteristics (Intellective or Judgmental); and group 
composition (Assertive-directing or Flexible-cohering). 

Interestingly, Medium and Task showed up as main effects, while Group 
Composition was not statistically significant. Significant interactions, 
however, cause us not to read too much into the main effects. 


ANOVA 


W 


Source 

imp 

Sum of 
Squares 

Mean 

Square 

F Value 

Pr > F 

Significant? 

Medium 

■n 



5.21 

0.026 

YES 

IPS 


hmebss 



0.864 

NO 

Task 

l 

110.19 


9.47 


YES 

Med*IPS 

I 

52.29 




YES 

Med*Task 

1 



7.75 


YES 


Means for Significant Treatments 


Treatment 

Means 

Direction of Shift 

FTF 

-1.5156 

Risky 

GSS 

0.4167 

Cautious 

BS£u! sEUElSUS suiSiJH 

-1.7422 

Risky 


0.6364 

Cautious 


Using LSD with: a =0.05, df=57, MSE=11.638 


A 
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Planned Contrast - Medium * Task 

Hypothesis 4a resulted in a significant outcome. The results suggest that 
FTF situations are especially potent in their impact on Judgmental or open 
ended problem situations. GSS has a general muting effect and causes a 
democratization of the outcome. 


w 

Planned Contrasts 
(Medium*Task Interaction) 



df 

Contrast SS 

Mean Square 

F Value 

Pr > F 

Significant? 

H4a 

1 

258.31 

258.31 

21.10 

0.0001 

YES 

H4b 

I 

33.64 

33.64 

2.75 

0.1025 

NO 


Means for Interaction Effects 

(Medium *Task) 


Treatment 

Level of Medium 

Level of Task 

Mean 

Standard 

Deviation 

Direction 

1 

FTF 

Comparison-poor 

-4.34 

4.16 

Risk 

2 

FTF 

Argument-poor 

0.68 

1.47 

Caution 

3 

Hgss 

Comparison-poor 

0.28 

4.22 

Caution 

4 

GSS 

Argument-poor 

0.58 

3.61 

Caution 


Using LSD; a=0.05, df=57, MSE= 11.64 
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Planned Contrast - Medium * Group Composition 


While neither of the hypotheses tested proved significant, the interesting 
contrast shown in the means for interaction effects suggests further work is 
required in this area. The use of GSS has no real effect for inherently balanced 
teams, i.e., teams with no “assertive members.” However, for teams that 
included natural leaders, GSS clearly muted the impact these leaders can wield 
over the group. In FTF situations, leaders are in their element and can bring 
considerable influence on the group’s decision. 


V 


Planned Contrasts 
(Medium* Interpersonal Style Interaction) 


1 Contrast 

wm 

Contrast SS 

Mean Square 

F Value 

Pr > F 

Significant? 

e n 


0.000 


WEEmm 

0.9992 

NO 


ClD 

76.26 

78.26 

EEH 

0.1025 

NO 


Means for Interaction Effects 
(Medium* Interpersonal Style) 


Treatment 

Level of Medium 

Level of Group Comp 

Mean 

Standard 

Deviation 

Direction 

1 

FTF 

Assertive-directing 

-2.65 

4.23 

Risk 

2 

FTF 

EBaaa 

-0.515 

3.28 

Risk 

3 

GSS 

Assertive-directing 

1.464 

3.47 

Caution 

4 

GSS 

Flexible-cohering 

-0.355 

4.10 

Risk 
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Summary of the Key Findings From the Analysis 

Group polarization is a complex phenomenon. Technology, Task and 
Group Composition all have varying levels of impact on this outcome. There is 
significant interaction between these independent variables; therefore, 
attention needs to be focused on cross-play of effects. 


Major Findings 

♦ Group polarization is confounded by the interplay of j 

technology with other vari ables consi dered important j 

♦ Task plays a significant role, but Interpersonal style by j 

itself i s not important j 

♦ Task* Medium interaction j 

- For Intellective task - Medium does not make a difference } 

- For Judgmental task - Medium effect is dramatic ! j 

♦ Interpersonal Style*Medium interaction | 

- Neither of our proposed hypothesis was supported j 

- Interactions however are interesting and should be further | 

investigated j 
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Insights on the Process Leading Up to Group Polarization 


A coding scheme was developed a priori to document the level of 
persuasiveness using the theory of persuasive arguments as our basis. The 
process for coding the transcripts included: defining “arguments” as the unit of 
analysis, classifying the arguments into different types of statements, and 
labeling the arguments by attributes of persuasiveness. In the GSS sessions, 
each separate remark was defined as an argument and used as a unit of 
analysis. In the face-to-face settings, an argument was defined as each 
uninterrupted statement/remark by a participant (Ericsson and Simon, 1993). 


w 

Documenting the Process 

Persuasive Arguments 
(Process Orientation) 


Measured by 

•Validity 

•Novelty 

•Support information 
•Number of arguments 


At 
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Summary of the Rules for Documenting 
Persuasiveness of Arguments 

The following slides indicate that Persuasiveness is a compound variable 
and the different facets of persuasiveness can be documented. The listing on 
the slide and the accompanying definitions are the basis for extracting the level 
of persuasiveness in an argument that is exchanged prior to a decision being 
made. 


Data Analysis 

Protocol Analysis 

Rules for content coding 



Categories of 

Persuasive 

Arguments 

Argument 

Attributes 

Definitions Used for 
Content-coding 

Validity 

• Truth 

- Statement is supported by the parameters 
defined by the problem £r the statement is 
supported by the documentation provided to 
the participants qt proof of truthfulness of die 
statement is provided by participant 21 the 
statement is otherwise verified. 


• Fit 

- Statement fits (is in line with) views 
previously expressed by the subject 21 the 
statement fits the current discussion thread 


• Follow 

- Statement follows from accepted facts qt 
follows previously expressed views by the 
subject. 


• Contribute 

- Statement supports, represents, or uses in 
some form one of the seven options provided 
as the final decision, 
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Additional Facets to Persuasiveness 


The following are additional aspects relating to persuasiveness of 
arguments. These rules were used to document the persuasive content of 
arguments exchanged both in the FTF and the GSS settings. 


Rules for Content Coding (Cont’d) 


V 


Categories of 

Persuasive 

Arguments 


Argument 

Attributes 

Definitions Used for 
Content-coding 

• New way 

- Statement indicates a new form of 
organizing the information. 


• Immediate response - Statement relates to some existing 

discussion thread. For FTF situation, the 
statement must be made within one minute 
of the related statement and in GSS 
situations, statement/remark was linked by 
the participant to the maior idea. 


► Delayed response - Statement relates to existing discussion 
thread, but the statement follows in a 
delayed manner * for FTF situations these 
statements follow after more than a minute 
for GSS situations, statement/remark was 
added as a separate idea but followed a 
previous train of thought. 


> Support to main idea - Statement provides direct support for an 
existing argument or idea 
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Graphical Depiction of the Level of 
Persuasiveness - Group Composition 

The accompanying slide demonstrates that Flexible-Cohering groups 
typically exchange a higher level of persuasive argument than groups 
dominated by an assertive member. 
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Graphical Depiction of the Level of 
Persuasiveness - Task Characteristics 

This graph suggests that Judgmental or Open-ended tasks typically cause 
more persuasion to occur among the group than for tasks that have a more 
clear cut answer associated with it. 
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Graphical Depiction of the Level of 
Persuasiveness - Effect of the Medium 


This is perhaps one of the most significant findings from this study. 
Contrary to the prior assertions in the GSS literature, technology mediation 
does not cause groups to evaluate or exchange a larger number of persuasive 
arguments. In fact, an FTF setting is a better environment for the exchange of 
ideas. While GSS had a larger number of arguments exchanged, the persuasive 
content was lower! 



133 






Process Related Observations 


Our study of the process of group decision making in terms of 
persuasiveness is a major contribution of this presentation. Protocol analysis, 
while a painstakingly detailed method of analysis, proved to be a useful 
technique in allowing us to unravel the process. Protocol analysis revealed an 
intriguing result; the level of persuasiveness was not as different as we had 
expected in the context of the dramatically different levels of polarization we 
reported. Since persuasiveness is considered a primary determinant of group 
polarization, this result is particularly curious. We believe this result opens up 
multiple avenues for future research. One such avenue is related to the nature 
of persuasive arguments. We have documented similarities in the 
persuasiveness of argument pools at the aggregate level; however, we have 
also found that distinctions can be made at a finer level of granularity. The 
rules that we have developed will allow researchers to further pursue this line 
of inquiry'. Future researchers would be well advised to use process tracing 
methods to further study persuasiveness by examining the elements that 
comprise it, what affects the nature of these elements and, finally, the impact 
of each of these elements on the group outcome of polarization. 




Process Related Observations 

♦ Need to focus on process - not just the outcome of group 
decisionmaking. 

♦ The study of “Persuasiveness” reveals interesting insights 
previously not considered by GSS researchers. 

♦ Rules for documenting persuasive arguments are an 
important contribution. 
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Conclusions and Implications of This Study 


An objective in this research was to study group polarization. The model 
used to study group polarization and the process that precedes it, uses variables 
(task characteristics and group composition) from the group polarization 
literature, and introduces technology as a new variable affecting group 
dynamics. While our results did not support all our hypotheses, one of our 
major findings is that Medium of communication interacts with Task to play a 
critical role in explaining the process and outcomes of group decisionmaking. 

Our results indicate that group polarization is a complex phenomenon 
with Medium of communication playing a central role. Clearly, any 
explanation of group polarization in today's team-based technology-supported 
workplace will be confounded by the interplay of technology with other 
variables previously deemed important by group polarization researchers. An 
interesting observation is that regardless of Task characteristics or Group 
Composition (see Figs. 2 and 3), GSS either does not alter or dramatically 
reduces polarization. When using GSS, decision makers should consider the 
nature of the task as well as the desired outcome. Low levels of polarization 
may not always be a positive outcome. For example, in some situations, the 
democratic process of reaching group consensus may not be the most 
effective, especially in situations where it is necessary to draw and identify 
individual member expertise and allow social dynamics to flourish. Decision 
makers should thus identify their particular situation with the knowledge that 
the Medium may interact with the Task to alter the nature of the process and 
the extent of the outcome. 


w 

Implications of This Study 


♦ Group Polarization occurs in both face-to-face and in 
computer mediated situations. 

♦ Medium of communication is critical to the final decision 
outcome 


- FTF causes shifts in the direction of risk for Judgmental 
(judgmental or unstructured) tasks 

♦ Presence of a strong leader in a group causes polarization 

- In the direction of the leader (FTF) 

- In a direction away from the leader (GSS) 


♦ 


Medium, Task and Group composition each impact the 
process of decisionmaking, but differently 


- Need to pay attention to their interactions 


ASUBUSINESS 


135 






List of References 


Ackoff, R. L., “Management Misinformation Systems,” Management Science, 
14(4), 1967, pp. 18-21. 

Baron, R. S. and Roper, G., “Reaffirmation of Social Comparison Views of 
Choice Shifts: Averaging and Extremity Effects in Auto-kinetic Situation,” 
Journal of Personality and Social Psychology, 33, 1976, pp. 521-530. 

Brown, R., Social Psychology, Free Press, New York, 1965. 

Bumstein, E., “An Analysis of Group Decision Involving Risk (the ‘Risky 
Shift’),” Human Relations, 22, 1969, pp. 381-395. 

Bumstein, E., “Persuasion as Argument Processing,” in M. Braandstatter, J. H. 
Davis and G. Stocker-Kreichgauer (eds.). Group Decision Processes, 
Academic Press, London, 1982, pp. 103-122. 

Dennis, A. R., George, J. F., Jessup, L. M., Nunamaker, J. F. and Vogel, D. 
R., “Information Technology to Support Electronic Meetings,” MIS 
Quarterly, 12 (4), 1988, pp. 591-624. 

Diehl, M. and Stroebe, W., “Productivity Loss in Brainstorming Groups: 
Toward the Solution of a Riddle,” Journal of Personality and Social 
Psychology, 53(3), 1987, pp. 497-509. 

Ericsson, K. A. and Simon, H. A., Protocol Analysis: Verbal Reports as Data 
(revised edition), MIT Press, Cambridge, MA, 1993. 

Green, D. and Conolley, E., “Groupthink and Watergate ” presented at Annual 
Meeting of the American Psychological Association, 1974. 

Heath, C. and Gonzalez, R., “Interaction with Others Increases Decision 
Confidence But Not Decision Quality: Evidence Against Information 
Collection Views of Interactive Decision Making,” Organizational 
Behavior and Human Decision Processes, 61(3), 1995, pp. 305-326. 

Hinsz, V. B. and Davis, J. H., “Persuasive Arguments Theory, Group 
Polarization, and Choice Shifts,” Journal of Personality and Social 
Psychology, 10(2), 1984, pp. 260-268. 

Isenberg, D. J., “Group Polarization: A Critical Review and Meta Analysis,” 
Journal of Personality and Social Psychology, 50 (6), 1986, pp. 1141- 
1151. 

Jessup, L. M., Connolly, T., and Gallegher, J., “The Effects of Anonymity on 
GSS Group Process with an Idea-Generating Task,” MIS Quarterly, 14(3), 
1990, pp. 313-321. 

Kaplan, M. F. and Miller, C. E., “Group Decision Making and Normative 
Versus Informational Influence: Effects of Type of Issue and Assigned 
Decision Rule,” Journal of Personality and Social Psychology, 53, 1987, 
pp. 306-313. 


136 



List of References (Cont’d.) 


Lamm, H. and Myers, D. G., “Group-Induced Polarization of Attitudes and 
Behavior,” Advances in Experimental Social Psychology, 1 1 , Academic 
Press, New York, 1978, pp. 145-195. 

Laughlin, P. R., “Social Combination Processes of Cooperative Problem 
Solving Groups on Verbal Intellective Tasks,” in M. Fishbein (ed.). 
Progress in Social Psychology, 1980, pp. 127-155. 

Lim, L. H. and Benbasat, I., “A Theoretical Perspective of Negotiation 
Support Systems,” Journal of Management Information Systems, 9(3), 
1993, pp. 27-44. 

Myers, D. G. and Lamm, H., “The Group Polarization Phenomenon,” 
Psychological Bulletin, 83, 1976, pp. 602-627. 

Nunamaker, J. F., Dennis, A. R., Valacich, J. S., Vogel, D. R. and George, J. 
F., “Electronic Meeting Systems to Support Group Work: Theory and 
Practice at Arizona,” Communications of the ACM, 34 (7), 1991, pp. 40- 
61. 

Poole, M. S., Seibold, D. R. and McPhee, R. D., “Group Decision Making as a 
Structuration Process,” Quarterly Journal of Speech, 71, 1985, pp. 74-102. 

Pruitt, D. G., “Choice Shifts in Group Discussion: An Introductory Review,” 
Journal of Personality and Social Psychology, 20 (3), 1971a, pp. 339-360. 

Valacich, J. S., Paranka, D., George, J. F. and Nunamaker, J. F., 
“Communication Concurrence and the New Media,” Communication 
Research, 20(2), 1993, pp. 249-276. 

Vinokur, A. and Bumstein, E., “Novel Argumentation and Attitude Change: 
The Case of Polarization Following Group Discussion,” European Journal 
of Social Psychology, 8, 1978, pp. 335-348. 

Zuber, J. A., Crott, H. W. and Werner, J., “Choice Shift and Group 
Polarization: An Analysis of the Status of Arguments and Social Decision 
Schemes,” Journal of Personality and Social Psychology, 62, 1992, pp. 50- 
61. 


137 




Computer-Supported Collaboration for High 
Performance Teams at Marshall 
Space Flight Center 


Brice F. Marsh 

Computer Sciences Corporation 
Huntsville, AL 


139 




Computer-Supported Collaboration for High-Performance 
Teams at Marshall Space Flight Center 


Brice F. Marsh 

Senior Computer Scientist and Electronic Meeting Specialist 
Certified Group Systems Facilitator and Instructor 
Computer Sciences Corporation 
Marshall Space Flight Center 
Huntsville, AL 35824 


CSC 

Computer-Supported Collaboration 
for High Performance Teams 
at Marshall Space Flight Center 


Brice F. Marsh 

Sr Computer Scientist & Electronic Meeting Specialist 
Certified GroupSystems Facilitator and Instructor 
Computer Sciences Corporation 
Marshall Space Flight Center 

Workshop on Advanced Group Support Systems and Facilities 
NASA Langley Research Center, Hampton, Virginia 
July 20, 1999 


141 




What is a High-Performance Team? 

This presentation describes a technique using collaborative software to improve 
the productivity and effectiveness of high performance teams. Some questions 
that need to be explored are: 

What is the difference between teams that merely perform and high-performance 
teams? 

How can computer- supported collaboration make a difference ? 


What is a high-performance team? 


What is the difference between 
teams that merely perform and 
high-performance teams? 

How can computer-supported 
collaboration make a difference? 
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From a 1998 Study on Teams... 


Here are some observations from a recent study about why individuals 
working as members of a team may be more effective in producing measurable 
results than if they were working independently. 


From a 1998 Study on Teams... 


“By pooling experience and perspective, teams are able to 
produce work that is above and beyond that of most 
individuals.” 

“Project teams bring together individuals of diverse 
backgrounds to work toward a common goal. This 
combination of skills and knowledge tends to produce 
products and processes that are more efficient and more 
likely to meet long-term organizational needs.” 
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More About Teams... 


The 1998 study entitled, “High Performance Teams,” was published by Kevin 
Cole, a consultant with Linkage, Inc. 

The premise that an organization needs to create a support system that 
encourages the team to forge their individual efforts into a collective, directed 
effort may be realized by using a type of computer-supported collaboration 
called an “electronic meeting system.” 


More about Teams... 


“Teams that ... do not allow opposing viewpoints will have a 
greater tendency toward groupthink. Effective teams develop 
the interactions to integrate differing perspectives while 
working together to meet organizational goals.” 

“To transform an average team into a high performance team 
an organization needs to create a support system that 
encourages the team to forge their individual efforts into a 
collective, directed effort.” 

1998 Study - High Performance Teams 
Kevin Cole, Consultant, Linkage, Inc. 
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Agenda 


In this presentation, we will explore how a type of computer-supported 
collaboration or electronic meeting system can help to transform an average 
team into a high performance team. 

We will also describe some success stories and examples of using an electronic 
meeting system. 

This type of collaborative support and productivity booster for teamwork is 
expected to produce meaningful benefits for virtual teams working in the 
Intelligent Synthesis Environment. 


Agenda 


• What is Computer-Supported Collaboration? 

• What is an Electronic Meeting System? 

• How can GroupSystems EMS help to 
transform an average team into a high 
performance team? 

• Success Stories & Lessons Learned 

• Retooling for the Virtual Work Space and 
the Intelligent Synthesis Environment 
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One of the Challenges of Teamwork... 


The challenge of using a team approach to capitalize on the collective skills and 
strengths of the individual team members is not new. Here we re-visit a 
quotation from one of America’s most revered statesmen and see that he had 
already encountered some of the travails of working in a high performance team 
environment. 


One of the challenges of teamwork... 


“When you assemble a group of people to have 
advantage of their joint wisdom, you inevitably 
assemble with those people all their prejudices, 
their errors of opinion, their local interests, and 
their selfish views. From such an assembly, can 
a perfect production be expected?” 

- Ben Franklin -1787 

U.S. Constitutional Convention 
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Now, 200 Years Later... 


And now, 200 years later, we are encountering similar challenges... but we 
have the benefit of computer-supported techniques to augment the 
effectiveness of the teams. 


Now, 200 years later... 


• Computer-supported collaboration is 
changing the way work is performed by 
high performance teams. 

• It works with virtually all types of teams. 

• It works with all types of groupwork activity. 

• And it works with conventional meetings. 
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Questions 

The questions we should consider as we look for ways to improve the 
performance of a team focus on meeting time, productivity and achievement of 
consensus or “buy-in” by members of the team. 



Questions 


How much of your 
teamwork time is 
spent in meetings? 

Are your meetings 
highly productive? 

Do you achieve 
consensus most of 
the time? 
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The Ideal Team Meeting 


At first, it may seem ludicrous to suggest that the ideal team meeting would 
allow everyone to talk at once; however, that is precisely one of the primary 
advantages of an electronic meeting system. 

If everyone can talk at once without being confused, and if everyone can 
hear, understand and remember everything that is said, this must be a 
powerful way to conduct team meetings. 

...And, by the way, it will no longer be necessary for anyone to keep the 
minutes... or to prepare flipcharts... or to make yellow sticky notes, to 
maintain a record or group memory of the proceedings of the team meetings. 
This will be produced as a by-product of the computer-supported approach to 
collaboration. 


The Ideal Team Meeting 

• Group of people 

• Everyone talks at once 

• Everyone hears 

• Everyone understands 

• Everyone remembers 

• Automatic minutes 
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Is the “Ideal Meeting” Possible? 


The “Ideal Meeting” may not always be attainable, but computer-supported 
collaboration or an electronic meeting system generally will produce a 
quantum leap in productivity and effectiveness of most team meetings. 


Is the “Ideal Meeting” possible? 

• Computer-Supported Collaboration 

• A Type of Collaborative Groupware 

• Electronic Meeting System (EMS) 
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Electronic Meeting System 


The Electronic Meeting System (EMS) enhances team performance and 
provides a functional and interactive working environment for all the members 
of the team. 

Each team member is provided with a computer and a keyboard; and all the 
members’ computers are interconnected in a local area network. Part of the 
collaborative software resides and runs in the individual networked computers, 
but the team’s database is maintained on the file server. 

A public display screen, usually in the form of a data projector, is used for the 
team members to view the anonymous contributions of other team members. 


Electronic Meeting System 



The Electronic Meeting System (EMS) enhances team 
performance and provides a functional and interactive 
working environment for all the members of the team. 
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What is EMS? 


An Electronic Meeting System includes a set of software tools (such as 
Electronic Brainstorming, Categorizer, Vote, Topic Commenter, Group 
Outliner, Survey, Opinion Meter, Alternative Analysis and a shared 
Whiteboard) to support working teams in a face-to-face meeting room or 
in a distributed or virtual environment. 

Team meetings may be either synchronous or asynchronous; and they may 
occur in same time/same place settings or in different time/different place 
settings, or some combination. 

However, group dynamics and facilitation issues are much more complex for 
asynchronous distributed meetings. 


What is EMS? 


• An Electronic Meeting System including: 

• A set of software tools (such as Electronic 
Brainstorming, Categorizer, Vote, Topic 
Commenter, Group Outliner, Survey, Opinion 
Meter, Alternative Analysis and a shared 
Whiteboard) to support working teams, 

• In a face-to-face meeting room or 

• in a distributed or virtual environment. 
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Needs Title 


The preferred physical arrangement for same time/same place team meetings 
is a room with tables placed in a “U-shape.” This preserves the confidentiality 
and anonymity of each team member, yet it is conducive to eye contact and 
verbal communication. 

A public display or projection screen is used to view the collective, yet 
anonymous, contributions of the team during deliberations. 

The role of the facilitator is to focus on the process of the meeting while team 
members focus on the content of the meeting. 
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Need Title 


There are five main reasons why EMS produces good results with high 

performance teams. 

1. Parallel or simultaneous input by all participants. Since computers allow 
everyone to “speak at once, electronically,” it is not necessary for each 
person to wait his turn to get the floor or to get his or her “air time.” 

2. Anonymity. Ideas and comments are evaluated on the merits of the ideas 
and not on the personality or clout of the person who originated the idea. 

3. Triggering. One member’s ideas will trigger other team members to think 
of things that never would have surfaced in conventional meetings. 

4. Structure and focus. The facilitation tools included in EMS allow the 
facilitator to help keep the team “on track and on schedule.” 

5. Record keeping. No longer is it necessary to use flipcharts and yellow 
sticky notes. The system may be used to produce a printed report of the 
meeting results immediately at the end of the meeting. 


Five Reasons EMS Works 


• Simultaneous Input 

• Anonymity 

• Triggering 

• Structure and Focus 

• Record Keeping 
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EMS Tools 


The Electronic Meeting System (EMS) provided by Ventana Corporation is 
called GroupSystems WorkGroup Edition. It includes a variety of 
collaborative tools. The facilitator works with the team leader or the meeting 
owner during preplanning steps to recommend a selection of tools and 
techniques to achieve the desired results of a specific team meeting. 


EMS TOOLS 

• Electronic Brainstorming: Unstructured idea generation 

• Categorizen Refine, Rearrange, Categorize ideas 

• Vote: Prioritize, Measure consensus, Graph results 

• Topic Commenter: Structured idea and information sharing 

• Group Outliner: Build hierarchical process models or WBS 

• Shared Whiteboard: Team Graphical Illustration 

• Report Writer: Store Results / Produce Reports 
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Advanced EMS Tools 


The GroupSystem WorkGroup Edition also includes some special purpose 
advanced collaborative tools. Included are the Alternative Analysis and Survey 
tools. 

Alternative Analysis : Evaluate alternatives using multiple criteria. Functions as 
group decision support tool. Generate “what-if” scenarios. Produce statistical 
and graphical results. 

Survey : Create electronic questionnaires, including subjective and objective 
items. Collect and tabulate responses. Produce varied reports. 


ADVANCED EMS TOOLS 


• Alternative Analysis: Evaluate alternatives using multiple 
criteria. Functions as group decision support tool. Generate “what-if 
scenarios. Produce statistical and graphical results. 

• Survey: Create electronic questionnaires, including subjective 
and objective items. Collect and tabulate responses. Produce varied 
reports. 
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Examples of Projects Supported 


A variety of team assignments may be supported using EMS. Each project 
may have a different process or objective. 

Examples of some types of team projects that have been supported with EMS 
are: 

• Process Redesign/Reengineering 

• Focus Groups/Process Action Teams 

• Functional Feedback on Prototype Systems 

• Legacy Systems Analysis 

• Migration/Transition Strategies 

• Requirements Definition 

• Strategic Planning 

• Conflict Resolution 

• Risk Mitigation Strategies 


Examples of Projects Supported 


• Process Redesign/Reengineering 

• Focus Groups/Process Action Teams 

• Functional Feedback on Prototype Systems 

• Legacy Systems Analysis Q 

• Migration/Transition Strategies 

• Requirements Definition E 

• Strategic Planning 

• Conflict Resolution 

• Risk Mitigation Strategies |j 
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EMS at MSFC 


The EMS software was acquired at Marshall Space Flight Center in 1995. Since 
that time a number of milestones have been reached: 

• Acquired EMS software - 1995 

• Pilot project funded by Employee and Organizational Development Dept. 

• Acquired portable system - 1996 

• Agency-wide license - 1998 

• Acquired wireless system - 1998 

• Almost 300 formal sessions conducted 

• Almost 4000 first-time participants 

• Strong approval/positive feedback 

• Growing demand for additional EMS support 


EMS at MSFC 

• 

Acquired EMS Software - 1995 

• 

Pilot project funded by E&ODO 

• 

Acquired Portable System - 1996 

• 

Agency-wide License - 1 998 

• 

Acquired Wireless System - 1998 

• 

Almost 300 Formal Sessions Conducted 

• 

Almost 4000 First-time Participants 

• 

Strong approval/positive feedback 

• 

Growing demand for additional EMS support 
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EMS Metrics at Marshall Space Flight Center 


• 10/96 - 9/97 (FY97) 

- 59 Sessions 902 Participants 

• 10/97 - 6/99 (FY98 & FY99 to date) 

- 173 Sessions 2,959 Participants 

• Totals to date 

- 232 Sessions 3,861 Participants 

• Special Events (Supported by EMS) 

- 24 Events 334 Participants (approximately) 

• Many other demos and informal sessions 


EMS at MSFC - Metrics 


• 1 0/96 - 9/97 (FY97) 

- 59 Sessions 902 Participants 

• 1 0/97 - 6/99 (FY98 & FY99 to date) 

- 173 Sessions 2,959 Participants 

• Totals to date 

-232 Sessions 3,861 Participants 

• Special Events (Supported by EMS) 

-24 Events 334 Participants (est.) 

• Many other demos and informal sessions 
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Feedback From Participants 


Feedback from participants indicates strong support and acceptance of the 
EMS approach to conducting team meetings. 


Feedback from participants... 


• “This is the best communication tool I have ever used 
at MSFC.” 

• “Would have never gotten such good results without 
it.” 

• “...this team accomplished more in two hours with EMS 
than we have in the two previous days.” 

• “...should be integrated into our everyday work 
processes.” 

• “Most productive workshop I have ever attended...” 

• “Great idea, should be used throughout MSFC.” 
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Need Title 


One of the survey questions included in the evaluation for each session asks 
the participants to indicate “strongly agree, agree, neutral, disagree, or 
strongly disagree ” with the statement: “EMS contributed significantly to the 
productivity of the meeting. ” 

More than 89 percent of the participants of a substantial number of meetings 
have responded with “strongly agree or agree. ” 


“EMS contributed significantly to 
productivity of the meeting” 
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MSFC Design Center Team 


One design center team offered a strong endorsement for EMS. 


MSFC Design Center Team 

• "The S&E Design Center Team used EMS on several 
occasions to facilitate team brainstorming and 
consensus. All these meetings achieved the desired 
ends. 

The general consensus of team members is that the 
tool and the facilitator effectively cut meeting time in 
half. Furthermore, the team decided that the 
capability of tools such as Ventana EMS should be 
included in the MSFC Design Center tool suite.” 

- Dale Thomas, Ph D 
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Some Specific EMS Sessions 


EMS has been used in a variety of actual team projects at Marshall Space Flight 
Center. 


Some Specific EMS Sessions 

■ Strategic Planning Workshops (32 Different Groups) 

■ AdminSTAR Requirements Definition 

■ PM/APM Sessions - Wallops island (APPL) 

■ Career Development Survey on the Internet 

■ Source Evaluation Boards/Committees 

■ (SEB/SEC) for NASA Research Announcements 
(NRAs) 

■ (Evaluated 200+ Proposals for 3 NRAs) 
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EMS at MSFC 


More actual examples of team projects that have used EMS. 


EMS at MSFC 


• Bantam Project (Congressionally- 
mandated Industry Review Conference) 

• MSFC Design Center Teams (PD/EL) 

• Leadership 2000 Committee, Huntsville 
Chamber of Commerce 

• MSFC Management Development 
Program (MDP) - Guntersville State Park 
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Other EMS Sessions 


Still more team projects that have used EMS. 


Other EMS Sessions 


■ NASA Agencywide Working Groups: 

>- Digital Television (DTV) Working Group 

*■ Integrated Financial Management Program 
(IFMP) 

>- 7120.5a Policy and Guidelines (Focus Group 
Review) 

»- Technology Assessment Working Group 
► CFO Strategic Planning Workshop - ARC 
»■ NASA Training Officers Workshop 
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Agency-Wide Deployment 


An agency- wide EMS license has been procured for NASA. The EMS support 
team at Marshall Space Flight Center has been instrumental in introducing and 
implementing EMS at several NASA Centers. A map on the next slide depicts 
the NASA Centers who have or who are in the process of implementing EMS. 
Several cross-Center teams, such as NASA’s Intelligence Syntheses 
Environment (ISE), Integrated Financial Management (IFM) Center Transition 
Managers (CTMs), and Source Evaluation Committees (SECs), have taken 
advantage of the EMS facility at MSFC and have expressed a desire to use 
EMS during follow-on meetings at the other Center locations. 


Agency-wide Deployment 

■ The EMS Support Team at MSFC has 
been instrumental in introducing and 
implementing EMS at several NASA 
Centers. 
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EMS at NASA Centers 


These are the NASA Centers who have or who are in the process of 
implementing EMS. 

The EMS Team from EODD at MSFC has provided briefings, remote and 
onsite demonstrations, as well as conducted actual working EMS sessions for 
various departments and teams at several of the NASA Centers. The result has 
been an increasing interest on the part of these Center personnel in 
participating in the NASA Master EMS license and in pursuing the acquisition 
and setup of an EMS capability at their Centers. EODD EMS Team members 
assist with the deployment of the licensed software to a Center and offer 
technical and functional assistance to the EMS installation staff in setting up 
their facility and in conducting initial EMS meetings. 
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EMS Software 


The EMS software used in the agency-wide license is: 

• GroupSy stems by Ventana Corp. 

• WorkGroup Edition 

• NASA has an agency-wide license 

• Managed by MSFC 

• Contact your Training Officer 


EMS Software 

• GroupSystems by Ventana Corp. 

• WorkGroup Edition 

• NASA has an agency-wide license 

• Managed by MSFC 

• Contact your Training Officer 
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What EMS Has Done 


At NASA, EMS has: 

• Developed a culture of creativity and innovation 

• Boosted Morale and Productivity 

• Driven meetings to do work rather than to work 


What EMS has done . . . 


• Developed a culture of creativity 

and innovation 

• Boosted Morale and Productivity 

• Driven meetings to do work rather 

than to plan work 
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Benefits of EMS 


Formal studies have documented significant benefits realized by using EMS. 



Benefits of EMS 



Labor 

Saved/Project 

Flow Time 
Saved 

No. of 
Projects 

IBM 

55.2% 

92% 

50 

Boeing 

72.0% 

65% 

64 
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Computer-Supported Collaboration 


Computer-Supported Collaboration 


Achieving Excellence with 
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More Information 


Anyone interested in using EMS to enhance team performance should contact the 
training officer at each NASA Center, or contact: 

Jerry Miller (256) 544-7555 - Jerry.miller@msfc.nasa.gov 

Bonnie Hankins (256) 544-1316 - Bonnie.hankins@msfc.nasa.gov 

Brice Marsh (256) 544-4417 - Brice.marsh@msfc.nasa.gov 


For More Information Contact: 

■ MSFC Employee and Organizational 
Development Department (EODD) 

► Jerry Miller - (256) 544-7555 

► EODD -(256) 544-7558 

► EMS Website: 

http://eodo.msfc.nasa.gov/EMS 

■ EODD EMS Support Team: 

► Bonnie Hankins - (256) 544-1316 

► Brice Marsh - (256) 544-4417 

► bmarsh@csc.com 
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